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I . INTRODUCTION  TO  CORRELATION 

Correlation  techniques  have  long  been  used  to  measure 
and  process  signals  in  physics,  chemistry  and  engineering. 

Lee  et  al  . , (1950)  discussed  the  application  of  correlation 
analysis  to  the  detection  of  periodic  communication  signals 
rather  early  and  later  reviewed  the  topic  in  some  detail  (Lee, 
I960).  Correlation  techniques,  again  applied  primarily  to 
communications,  have  also  been  discussed  by  Lange  (1967)  and 
were  applied  at  a relatively  early  stage  to  the  analysis  of 
elec troencephe log rapliic  data  (Rosonblith,  1959  and  Barlow, 

1959)  . Although  correlation  techniques  have  been  employed  in 
these  and  other  fields  with  considerable  advantage  and  success, 
their  use  has  unfortunately  been  somewhat  limited  by  a lack  of 
understanding  of  th^  principles  involved  in  the  computation, 
utilization,  and  measurement  of  correlation  functions.  In 
addition,  for  practical  purposes  it  has  been  difficult  to  use 
correlation  techniques  because  effective  methods  and  instru- 
mentation were  not  variable  for  the  rapid,  automatic  evalu- 
ation of  correlation  functions. 

In  this  chapter,  we  will  attempt  to  present  a treatment 
of  correlation  analysis  that  is  both  understandable  and  useful 
to  the  practicing  scientist  or  chemist.  Many  treatments  of 
correlation  analysis  lose  the  basic  simplicity  of  the  technique 
in  an  excess  of  mathematical  equations  and  in  applications  to 
arbitrary  waveform'-.  Throughout,  a qualitative  or  semi- 
quantitative  view  iiill  be  adopted,  with  a minimum  amount  of 
mathematical  detail  While  some  rigor  will  necessarily  be  sac- 
rificed by  this  ap'-voach,  we  feel  that  the  importance  and  utility 
of  the  ubiquitous  relation  operation  will  be  rendered  most 
meaningful  to  the  Majority  of  readers. 
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Today,  there  i::  rapid  qrcwth  in  the  utilization  of  correl-  jj 

ation  methods  for  the  measurement  of  chemical  data.  Many  com- 
puter signal  processing  methods  are  based  on  correl at ion  and 
scientists  are  increasingly  using  techniques  that  are  inherently 
based  on  correlation  for  the  measurement  and  generation  of  chemical 
data.  In  large  part,  this  upswing  in  the  utilization  of  correl- 
ation techniques  is  due  to  developments  in  instrumentation. 

« \ 

A number  of  commercial  hardware  correlators  are 
available  and  the  ready  availability  of  diqital  computers  in 
most  laboratories  makes  software  approaches  to  correlation 
both  simple  and  relatively  inexpensive.  In  addition,  the 
rapid  development  of  increasingly  sophisticated  electronic  cir- 
cuitry  in  small  inexpensive  packaqes  can  be  expected  to  produce 
a number  of  new  and  unique  approaches  to  the  design  of  laboratory- 
oriented  correlators.  These  advances  in  instrumentation  and 
software  are  certain  to  generate  further  rapid  growth  in  the 
utilization  of  correlation  techniques  in  experimental  science; 
consequently,  it  is  essential  that  workers  in  all  branches  of 
science  become  increasingly  aware  of  correlation  operations, 
their  use  and  their  application. 

A . WHAT  IS  CORRELATION? 

Simply  stated,  correlation  analysis  provides  information 
about  the  coherence,  within  a signal  or  b.  ween  two  signals. 

The  correlation  function  of  two  signals  is  obtained  by  evalu- 
ating the  time  averaged  or  integrated  product  of  the  two  signals 

il 

as  a function  of  their  relative  displacement.  Mathematically, 

■ 

correlation  can  be  expressed  as: 
f 

I 
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where  ca^(T)  is  the  correlation  function  between  the  two  siqnals 
a(t)  and  b(t),  and  t is  their  relative  displacement.  The  signals 
can  be  a function  of  essentially  any  variable,  e.q.  wavelenqth, 
retardation,  frequency,  accelerating  voltage,  time  etc.  Thus, 
if  a and  b are  considered  to  be  functions  of  time,  the  correla- 


tion function  will  be  related  to  and  plotted  against  the 

relative  time  delay  between  the  two  signals. 

In  most  situations,  correlation  is  implemented  on  dig- 
itized signals.  For  digitized  signals,  the  calculation  of  the 
correlation  function  can  be  expressed  by  the  following  summation 


c . ( n A t ) 


The  signals  can  only  be  displaced  some  integral  number  of  the 
sampling  interval,  Ax.  Thus,  the  displacement  nAx  is  equiva- 
lent to  t in  Equation  1 . 


Two  different  correlation  operations  can  be  identified 


tion  function  is  obtained  by  application  of  Equation  1 . Thus 


autocorrelation  indicates  whether  coherence  exists  within  a signal 


In  contrast,  a cross-correlation  function,  produced  if  a(t)  and 


b(t)  are  different,  shows  the  similarities  between  the  two  sig 
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1.  Autocorrelation 

To  illustrate  the  process  of  correlation,  let  us  consider 
a simple  instrument  capable  of  producing  a correlation  function. 

Prom  Equation  1,  correlating  two  signals  that  are  functions  of 
time  merely  involves  multiplying  one  of  them  (a(t))  by  a delayed 

4 

version  of  the  other  (b(t-t)),  averaging  the  product  and  expres- 
sing the  averaged  value  as  a function  of  the  chosen  delay.  An 
instrument  capable  of  performing  these  procedures  is  shown  in 
Figure  1;  its  operation  can  be  understood  most  simply  by  auto- 
correlating  a simple  sine  wave. 

If  a sine  wave  is  to  be  autocorrelated , it  will  have  to 
be  sent  simultaneously  into  both  inputs  of  the  correlator.  To 

a 

begin,  assume  that  t * 0;  that  is,  that  the  sine  wave  is  multip- 
lied by  itself  in  phase.  When  this  occurs,  the  output  from  the 

2 

multiplier  will  be  a sine  wave,  as  illustrated  in  Figure  2a; 
this  will  produce  an  output  from  the  averager  equal  to  the  mean 
square  of  the  original  sine  wave.  Thus  as  plotted  in  Figure  3, 
the  value  of  the  autocorrelation  function  at  t = 0 will  be  the 
mean  square  of  the  original  wave. 

Now  imagine  that  the  variable  delay  in  the  autocorrelation 
computer  (Figure  1)  has  been  increased  (manually  or  automatically)  * 
by  an  amount  of  time  equal  to  one-quart'  period  of  the  original 
sine  wave.  Under  those  conditions,  the  sine  wave  will  be  multip- 
lied by  a version  of  itself  which  is  effectively  phase-shifted 
by  90*.  As  shown  in  Figure  2b,  this  multiplication  will  generate 
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a wave  having  an  average  value  of  zero.  This  value  has  also 
been  plotted  in  Figure  3. 

The  variable  delay  is  now  increased  to  a time  equal  to 
one-half  period  of  the  input  sine  wave  to  produce  a situation 
depicted  in  Figure  2c.  The  averaged  multiplier  output  is  now 
just  the  negative  mean  square  of  the  sine  wave,  and  is  again 
shown  plotted  in  Figure  3.  Increasing  the  delay  another  quar- 
ter period  causes  the  original  wave  to  be  270°  out  of  phase 
with  its  delayed  replica,  so  that,  as  shown  in  Figure  2d,  the 
product  again  has  a zero  average. 

Finally,  when  the  variable  delay  has  been  increased  to 
a time  exactly  equal  to  one  period  of  the  input  sine  wave,  the 
wave  and  its  delayed  replica  will  once  more  appear  to  be  in 
phase,  to  produce  a situation  identical  to  that  when  the  delay 
(t)  was  zero.  From  this  and  Figure  3,  it  should  be  apparent 
that  the  autocorrelation  function  of  a sine  wave  is  itself 
sinusoidal,  but  has  its  maximum  value  shifted  to  coincide  with 
t " 0.  Mathematically , this  means  that  the  sine  wave,  of  in- 
determinate phase,  has  been  converted  to  a cosine  wave.  Thus, 
if  the  original  wave  were  expressed  as 


a (t) 


Acos(2irft  + 0) 


where  A is  the  maximum  amplitude  of  the  sine  wave,  f is  its 
frequency  and  0 its  phase,  the  autocorrelation  function  of  the 


wave  would  follow  the  relation: 


\ 


a 

Caa(t)  * j-  COS(2uft)  (4) 

From  this  rei^plt,  Figure  3,  and  the  preceding  discussion, 
several  important  characteristics  of  the  autocorrelation  func- 
tion should  be  evident.  First,  the  autocorrelation  function  is 
even;  that  is,  it  is  symmetrical  about  the  point  t * 0.  In  ef- 
fect, this  is  identical  to  saying  that  either  of  the  two  chan- 
nels of  the  autocorrelator  of  Figure  1 can  contain  the  variable 
delay  network,  and  that  changing  the  delay  to  the  opposite 
channel  has  the  mathematically  interpreted  consequence  of  using 
a negative  delay.  Secondly,  the  amplitude  and  frequency  (or 
period)  of  the  autocorrelation  function  are  unambiguously  re- 
lated to  those  of  the  original  sine  wave.  The  period  of  the 
two  are,  of  course,  identical  while  the  amplitude  of  the  auto- 
correlation function  is  just  the  mean  square  of  the  original . 

A third  property  of  the  autocorrelation  function  of  Figure  3 
is  its  infinite  length. 

Any  periodic  function  will  display  a similar  character- 
istic since  any  such  waveform  is  just  a combination  of  a number 
of  constituent  sine  waves,  each  with  its  own  amplitude  and 
phase  characteristics.  This  periodicity  or  coherence,  observed 
in  most  signals,  is  the  feature  which  enables  them  to  be  sep- 
arated so  effectively  from  superimposed  noise,  which  is  ordin- 
arily neither  periodic  nor  coherent. 


Finally,  although  frequency  and  amplitude  information 
about  the  original  waveform  is  carried  in  the  autocorrelation 
function,  the  phase  of  the  original  signal  is  lost.  This  fact 
is  emphasized  by  the  autocorrelation  function  of  a square  wave, 
shown  in  Figure  4 and  constructed  just  as  for  the  sine  wave 
of  Figure  2.  The  triangle  wave  autocorrelation  function  shown 
in  Figure  4 contains  the  same  frequencies  (i.e.  sine  wave 
components)  as  did  the  original  square  wave.  However,  in  the 
triangular  wave  all  the  sine  waves  are  in  phase,  to  produce  a 
different  summation  wave  shape.  In  the  understanding  of  the 
square  wave  autocorrelation,  it  is  instructive  to  imagine  the 
two  square  waves  sliding  past  each  other.  The  autocorrelation 
function  is  just  the  changing  mutual  area  of  the  two  functions. 

A familiar  example  of  a related  autocorrelation  is  the 
scanning  of  a spectral  line  (image  of  the  entrance  slit)  across 
the  exit  slit  of  a monochromator  to  produce  the  slit  width 
limited  triangular  resolution  function.  This  autocorrelation 
operation  is  illustrated  in  Figure  5. 

Autocorrelation  on  non-periodic  or  random  (noise)  wave- 
forms produces  markedly  different  results  from  those  obtained 
for  periodic  waves.  To  understand  this,  we  need  only  recognize 
that  any  wave,  whether  periodic  or  not,  5s  composed  of  sine 
wave  components.  Each  of  these  components,  when  autocorrelated , 
will  produce  a cosine  wave  beginning  at  t * 0.  When  many  such 


components  arc  present  in  a parent  waveform,  the  resulting  auto- 


correlation  will  just  be  the  sum  of  the  autocorrelation  func- 
tions of  the  components,  as  illustrated  in  Figure  0.  A true 
random  waveform  (white  noise)  contains  all  frequencies.  The 
cosine  autocorrelation  images  of  all  these  frequencies  rein- 
force at  t = 0 to  produce  a value  equal  to  the  mean  square 
of  the  original  random  siqnal  and  at  any  point  beyond  t = 0 
they  destructively  interfere  to  produce  a time  averaged  value 
of  zero  (see  Figure  7) . 

In  order  to  obtain  this  ideal  autocorrelation  function 
of  random  noise,  the  bandwidth  of  the  noise  must  be  infinite. 

Of  course,  no  process  in  nature  is  truly  random.  Real  random 
waveforms  are  "band-limited'  and  do  not  produce  a single  spike 
upon  autocorrelation  but  instead  a shape  such  as  portrayed  in 
Figure  8a.  The  functional  form  is  a decaying  exponential  whose 
width  is  inversely  proportional  to  the  bandwidth  of  the  noise 
waveform.  Note  that  in  Figure  8a,  both  sides  of  the  autocor- 
relation function  have  been  included  to  demonstrate  its  sym- 
metry. In  all  other  presentations,  only  one  side  of  the  autocorrel 
ation  function  will  be  given;  the  reader  should  recall  the 
actual  symmetrical  characteristic. 

When  Figure  8a  is  compared  with  Figures  3 and  4 , it  is 
clear  why  autocorrelation  is  such  a powerful  technique  for  the 
extraction  of  periodic  signals  from  noise  (Hieftje,  1972a; 

Hieftje,  1972b).  Most  noise,  being  inherently  random,  contributes 
to  the  autocorrelation  function  only  at  very  small  values  of  x . 


A periodic  signal,  in  contrast,  will  continue  to  contribute 
even  at  very  large  values  of  t.  Therefore,  to  measure  the 
amplitude  and  frequency  of  a periodic  signal  buried  in  noise, 
it  is  necessary  to  examine  the  autocorrelation  function  at  a 
location  yell  removed  from  the  central  (x  - 0)  peak.  To 
clarify  this  point,  the  autocorrelogram  (autocorrelation  func- 
tion) of  a noisy  sine  wave  is  portrayed  in  Figure  8b. 

The  autocorrelation  function  also  provides  a very  con- 
venient means  of  determining  the  signal-to-noise  ratio  of  a 
measured  waveform.  As  illustrated  in  Figure  8b,  the  value  of 
the  autocorrelation  function  at  r ■ 5 is  just  the  mean  square 
of  the  original  signal  plus  noise,  whereas  the  peak  of  the 
autocorrelogram  at  large  values  of  t is  equal  to  the  mean  square 
of  the  signal  alone.  Because  the  mean  square  value  is  directly 
proportional  to  the  power  of  an  alternating  waveform,  the  signal- 
to-noise  power  ratio  can  be  calculated  from  the  mean  square  of 
the  signajL  divided  by  the  difference  between  the  measured 
quantities  (S+N  and  S) . 

2 . Cross-correlation 

Cross-correlation  analysis  is  similar  in  structure  and 
concept  to  autocorrelation  except  that  in  cross-correlation 
the  coherence  between  two  waveforms  is  exa.  ined  rather  than  the 
coherence  within  a waveform.  From  our  discussion  of  autocorrel- 
ation, it  should  be  clear  that  this  coherence  can  only  exist 
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for  frequency  components  which  are  cojnmon  to  the  two  waves. 

This  is  true  because  multiplication  of  two 'sinusoidal  wave- 
forms of  different  frequency  produces  a waveform  which  is  it- 
self symmetrical  about  zero  and  has  a zero  time  average. 

For  example,  if  two  waveforms  to  be  cross-correlated 
are  sinusoidal  and  of  the  same  frequency,  the  situation  is 

I 

similar  to  that  discussed  earlier  for  autocorrelation.  However, 
unless  the  two  sine  waves  happen  to  be  in  phase,  the  cross- 
correlation function  will  not  be  symmetrical  about  i = 0,  but 
will  be  displaced  by  an  amount  related  to  the  phase  difference. 

This  is  illustrated  in  Figure  9.  For  two  waves  of  different 
shape  but  containing  common  frequency  components,  the  situation 
is  even  more  complex.  A sine  wave  and  square  wave  of  the  same 
fundamental  frequency  will  thus  cross-correlate  to  a sine  wave 
of  that  frequency,  which  is  the  only  component  common  to  both. 
Furthermore,  the  shift  of  the  cross-correlation  function  from 
t = 0 will  once  more  indicate  the  phase  relationship  between 
that  frequency  component  in  the  two  waves. 

With  random  or  stochastic  waveforms  (i.e.  noise),  cross- 
correlation behaves  quite  differently  from  autocorrelation.  In 
particular,  because  any  two  random  waveforms  are  inherently 
independent,  they  will  not  correlate  at  any  point,  so  that  the  cross- 
correlation  function  will  everywhere  be  zero  as  the  product  of 
two  random  functions  will  itself  be  random  and  thus  have  a zero 
time  average.  This  property  is  extremely  important  in  signal 
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processing  applications,  where  a noisy  signal  Is  to  bo  detected 
with  the  ^id  of  an  available  reference  wave  at  the  same  fre- 
quency. Consider,  for  example,  the  detection  of  a noisy  square 
wave  signal  using  a noise-free  sinusoidal  reference  wave.  The 
only  common  feature  between  the  signal  and  reference  waves  is 
that  component  at  the  reference  wave  frequency;  this  component 
alone  will  thus  appear  in  the  cross-correlation  function. 

The  cross-correlation  function  (at  r - 0)  will  then  have 
an  amplitude  equal  to  the  averaged  product  of  the  noise  free  sig- 
nal and  reference  waves  (See  Figure  10) . 

It  will  be  obvious  to  most  readers  that  the  cross- 
correlation operation  depicted  in  Figure  10  forms  the  basis  of 
the  lock-in  amplifier  (Malmstadt  et  al , 1974;  Hieftje,  1972a, 

1972b) . The  only  major  additional  component  in  a lock-in 
amplifier  is  a phase  shifting  circuit,  usually  on  the  reference 
channel.  This  allows  the  output  of  the  correlator  to  be  maxi- 
mized by  insuring  that  the  signal  and  reference  waveforms  are 
in  phase . 

The  fact  that  the  amplitude  of  the  cross-correlation 
function  depends  both  on  the  reference  and  signal  wave  ampli- 
tudes can  often  be  used  to  advantage  in  signal  processing  appli- 
cations (Hieftje  et  al,  1973b).  Merely  by  increasing  the  magnitude 
of  the  reference  wave,  the  cross-correlogram  amplitude  can  be 
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enlarged;  this  is  clearly  advantageous  ovei  the  autocorrelation 
operation,  where  no  reference  wave  exists  and  the  final  coi rel- 
ation function  is  only  as  largo  as  the  mean  square  of  the  orig 

inal  signal. 

From  the  foregoing  discussion,  it  should  be  apparent 
that  correlation  operations,  while  outwardly  and  mathematically 
a bit  forbidding,  are  actually  quite  simple.  Mao,  several 
important  characteristics  of  both  auto-  and  cross -cm r el  at i on 
have  been  shown  to  be  of  importance  to  the  detect  ion 
of  signals.  The  examples  shown  have  primarily  ut  i \ i 
periodic  type  signals.  A considerable  number  of  signals  of 
chemical  interest  consist  of  peaks.  Several  examples  illus- 
trating the  application  of  correlation  to  the  measurement  and 
processing  of  peak  like  signals  will  be  discussed  ’ % t « * r . Rut 
first,  two  related  areas  must  be  covered,  convolution  and 
Fourier  transformation.  Some  knowledge  of  these  irons  i *>  im 

portant  |or  a full  understanding  of  correlation  opei.it  lonn. 

« 

B.  CONVOLUTION 

A number  of  the  a .pects  of  correlation  that  have  . on 
introduced  are  perhaps  more  familiar  to  the  reader  under  the 
term  convolution.  However,  convolution,  an  operation  which 
occurs  duting  the  generation  or  measures! .nt  of  all  signals, 
can  bo  considered  to  be  merely  a special  kind  ot  correlation 
process.  Mathematically,  convolution  can  be  expressed  as 
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Tf  equations  5 and  1 tiro  compared,  the  it  only  diffi'n’iUi' 
is  observed  to  be  a minus  sign  in  front  of  the  t of  the  ' func- 
tion. The  effect  of  this  minus  sign  is  to  Jevetse  the  b(t) 
function  (from  left,  to  right)  on  the  time  axis  before  it  is 
multiplied  by  a(t).  The  rest  of  the  shifting,  multiplying  and 
averaging  procedures  are  identical  to  those  employed  in  correl 
ut;on.  Therefore,  correlation  and  convolution  are  identical, 
except  that  in  convolution,  one  of  the  signals  is  first  reversed. 

The  reason  for  this  can  be  best  understood  with 
the  aid  of  an  example.  Consider  a rapid  signal  change  (step) 
being  displayed  on  a recorder  having  a relatively  long  time  con- 
stant. The  recorded  signal  will,  of  course,  not  be  identical 
with  the  original  step  but  will  reflect  the  response  time  of 
the  recorder  (McWilliam  and  Bolton,  1969).  For  simplicity, 
lot  us  assume  that  the  recorder's  response  is  exponential,  as 
shown  in  Figure  11.  By  convention  both  the  input  to  the 
recorder  and  its  response  function  are  expressed  with  time 
increasing  to  the  right.  Therefore,  if  wo  imaqino  the  input 
signal  entering  the  recorder,  it  is  apparent  that  the  loft 
side  of  the  signal  would  enter  first  and  encounter  the 
response  function.  For  this  to  occur  properly,  either  the 
signal  or  the  response  function  must  be  reversed.  Tt  is  con- 
ventional to  reverse  the  response  function.  Thus  l lie  re- 
corded signal  is  then  the  convolution  of  the  input  step  and 


tho  rrcordcr's  response  function.  Notice  that,  it  a correla- 
tion between  those  two  functions  were  produced  by  the  recorder, 
the  leading  edqe  of  the  recorder's  output  would  be  curved  up- 
ward rather  than  downward,  as  shown  in  Figure  11. 

From  these  considerations,  convolution  can  bo  seen  to 
be  merely  a special  kind  of  correlation  and  can  often  bo  ■imple- 
mented and  utilized  in  similar  ways.  In  fact,  in  those  many  in- 
stances in  which  the  response  function  b(t.)  is  symmetrical, 
its  inversion  produces  no  change,  so  that  correlation  and  con- 
volution provide  identical  results. 

C . FOURIER  TRAN S F 0 RMS  IN  CORRELATION 

As  mentioned  in  the  introduction,  the  ready  availability 
of  digital  computers  in  most  laboratories  facilitates  software 
approaches  to  correlation.  In  particular,  the  Fast  Fourier 
Transform  algorithm  has  essentially  revolutionized  the  extent 
to  which  correlation  techniques  can  be  implemented  on  computers 
and  indeed  many  correlation  based  techniques  are  more  commonly 
referred  to  as  Fourier  transform  techniques.  In  addition  to 
providing  a convenient  route  for  the  implementation  of  correl- 
ation, a knowledge  of  Fourier  transforms  also  aids  the  utiliz- 
ation and  understanding  of  correlation  operations.  A very 
important  theorem  concerning  correlation  sf  ■«tes  that  correlation 
of  two  waveforms  is  equivalent  to  multiplication  of  their 
Fourier  transforms  followed  by  inverse  Fourier  transformation 
of  the  product.  Schematically,  this  sequence  can  be  represented 
in  the  following  way; 
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The  asterisk  in  Equation  6 is  merely  a common  -shorthand  way 
to  denote  correlation;  Equation  6 is  therefore  identical  to 
Equation  1.  It  should  be  noted  that  this  shorthand  form  is 
used  by  many  authors  to  designate  convolution  as  well.  How- 
ever, in  this  chapter  we  will  employ  it  exclusively  to  denote 
correlation. 

Notice  that  in  Equations  6 and  7,  cross-correlation  is 
shown  to  involve  nothing  but  a multiplication  process  in  the 
Fourier  domain.  Simple  as  this  aspect  of  correlation  might 
seem,  it  is  of  paramount  importance.  A large  fraction  of  soft- 
ware and  hardware  methods  for  obtaining  the  correlation  function 
rely  on  the  Fourier  transform  method  because  of  its  speed  and 
relative  simplicity.  Let  us  consider  the  Fourier  process  in 
a bit  more  detail. 

* 

Fourier  transformation  is  a mathematical  means  of  re- 
lating two  functions.  It  may  be  stated  as: 


a (t) 


A(f ) e2nitfdf 


1(> 


The  inverse  Fourier  transform  is; 


■/.: 


_ -2nitf 
a (t)  e dt 


The  functions  a(t)  and  A { f ) constitute  a Fourier  transform 
pair.  Fourier  transformation,  as  it  is  usually  applied  in 
chemistry,  involves  the  determination  of  the  frequency  com- 
position of  a waveform.  Often  the  waveform  (n(t))  will  repre- 
sent a time-varying  property  of  a substance  or  device  under  in- 
vestigation, in  which  case  the  frequency  composition  (A(f))  will 
be  expressed  in  units  of  sec  * or  Hz.  However,  as  discussed 
earlier  with  regard  to  correlation,  a waveform  being  transformed 
can  be  a function  of  any  variable. 

The  frequency  composition  of  a waveform  is  ordinarily 
expressed  in  the  form  of  a spectrum,  which  is  merely  a plot  of 
the  relative  density  of  each  component  as  a function  of  fre- 
quency. It  is  important  to  distinguish  this  kind  of  spectrum 
from  one  produced  by  an  optical  or  other  spectromet r ic  instru- 
ment so  often  used  in  chemistry.  For  clarity,  we  will  refer  to 
the  spectrum  produced  upon  Fourier  transformation  as  the  Fourier 
spectrum  or  the  Fourier  domain  signal. 

A number  of  the  basic  properties  of  Fourier  transforms 
and  their  relation  to  spectroscopic  measurements  have  been  dis- 
cussed by  Horlick  (1971).  In  the  next  sl\  ion,  the  important 
role  of  Fourier  transforms  in  implementing  correlation  based 
signal  processing  operations  will  be  emphasized. 
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II.  CORRELATION  BASED  SIGNAL  PROCESSING  OPERATIONS 

One  of  the  most  common  areas  where  correlation  tech- 
niques are  utilized  in  chemistry  is  in  the  software  processino  of 
signals.  Here  processing  refers  to  such  varied  operations  as 
smoothing,  differentiation,  resolution  enhancement,  deconvolu- 
tion, and  signal  detection.  In  the  main,  these  operations 
are  applied  to  a signal  after  it  has  been  digitized  and  stored 
in  a computer  and  as  such,  this  type  of  signal  processing  is 
often  referred  to  as  digital  filtering.  Digital  filtering 
techniques  have  been  used  for  many  years  to  process  chemical 
signals.  The  basic  equation  for  digital  filtering  is  tho 
correlation  equation.  Equation  1.  In  a now  classic  paper, 
Savitzky  and  Golay  (1964)  presented  several  types  of  correla- 
tion filters  for  smoothing  and  differentiation  of  data.  In 
recent  years,  the  Fourier  domain  route  of  correlation  (Equa- 
tions 6 and  7)  has  become  popular  for  implementing  digital  fil- 
tering operations  on  a variety  of  chemical  signals  (Horlick 
1972a;  Betty  and  Horlick  1976;  Hayes  et  al  1973;  Bush  1974, 
Caprini  1970;  Inouye  1969;  Kirmse  1971). 

In  this  chapter,  the  application  of  Fourier  domain  dig- 
ital filters  to  signals  of  chemical  interest  will  be  presented. 

In  particular,  a digital  filter  based  on  a simple  trapezoid 
is  shown  to  be  uniquely  versatile.  When  -''-plied  to  signals 
using  Equation  7;  smoothing,  differentiation,  resolution  en- 
hancement or  deconvolution  can  easily  be  implemented.  In  add- 
ition, digital  filtering  is  often  used  as  a preprocessing  step 
in  signal  detection  operations.  This  aspect  of  correlation 
will  also  be  discussed. 
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A . BASICS  OF  FOUR I ER  DOMAIN JD IGITAL  F ILTERING 

The  Fourier  transform  route  of  correlation  is  an  effec- 
tive way  of  implementing  digital  filtering  operations  and  all 
examples  illustrated  in  this  section  were  carried  out  in  this 
fashion.  A Fast  Fourier  Transform  (FFT)  (Singleton,  1969)  was 
used  to  carry  out  the  transformation  of  the  signals  and  the 
inverse  transformation  of  the  filtered  Fourier  domain  signal. 
This  algorithm,  of  which  several  versions  are  available,  is 
simply  a rapid,  efficient  means  for  calculation  of  the  Fourier 
transformation  of  a set  of  points.  The  input  to  a typical 
program  is  a set  of  real  data  (i.e.  a digitized  waveform  in  a 
computer) . The  output  of  a typical  FFT  program  consists  of 
two  series,  the  real  part  of  the  transform  (X(J)]  and  the  imag- 
inary part  lY ( J) ) . These  two  outputs  can  be  used  to  generate 
two  additional  series,  the  amplitude  Fourier  spectrum  of  the 
original  waveform  and  the  phase  spectrum  of  these  Fourier 
frequencies.  The  amplitudes  of  the  Fourier  frequencies  [A(J)1 
are  calculated  from  the  real  and  imaginary  outputs  by  taking 
the  root  sum  of  squares  of  the  two  series  i.e.: 

A ( J)  = (X  (J)  2 + Y ( J)  2]  1/2  (10) 

The  phases  of  these  Fourier  frequencies  ,r*(J)1  are  calculated 
using  the  following  equation: 

P(J)  - arctan  [Y(J)/X(J)J  (11) 


i 


All  those  outputs  are  illustrated  in  Figure  12.  The 


ori-9ina^  input  waveform  (Figure  12a)  is  a typical  peak  .signal. 
The  real  output  of  the  FFT  for  this  input  waveform  is  simply 
a damped  cosine  wave.  The  frequency  of  this  cosine  wave  de- 
• pends  on  the  position  of  the  peak  with  respect  to  the  origin 

of  the  input  waveform,  the  functional  form  of  the  damping  de- 
pends on  the  shape  of  the  peak  in  the  original  waveform 
(Horlick, 1971)  . The  imaginary  output  is  a damped  sine  wave 
with  similar  characteristics  to  the  real  output. 

The  amplitude  spectrum  of  the  Fourier  frequencies  in- 
dicates that  the  original  waveform  is  composed  mainly  of  low 
Fourier  frequencies  along  with  a relatively  large  dc  level. 

The  amplitudes  of  the  higher  Fourier  frequencies  are  small 
but  their  presence  is  significant  in  that  it  is  primarily  these 
frequencies  that  make  up  the  noise  in  the  original  waveform. 
Thus  the  information  about  the  original  peak  occurs  in  a dif- 
ferent region  of  the  Fourier  frequency  spectrum  than  does  some 
of  the  noise  information.  This  difference  in  spectral  char- 
acteristics enables  noise  information  to  be  attenuated  without 
loss  of  signal  information.  This  forms  the  basis  for  spectral 
smoothing  operations  in  the  Fourier  domain. 

The  phase  spectrum  provides  information  about  the  phase 


angle  of  the  individual  Fourier  frequencies  at  one  specific 
point  on  the  original  waveform.  The  phase  is  most  useful  when 
calculated  with  respect  to  a point  on  the  original  wave  at 
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which  the  Fourier  frequencies  all  have  approximately  the  same 
phase  angle.  For  the  waveform  illustrated  in  Figure  12a,  this 
point  is  the  peak  maximum.  This  phase  coherence  is,  in  fact, 
the  reason  for  the  cxistance  of  the  peak  when  the  waveform  is 
interpreted  as  a Fourier  Summation  of  individual  frequencies 
(Malmstadt  et  al . , 1974). 

It  is  clear  from  the  phase  spectrum  that  the  lower 
Fourier  frequencies  which  characterize  the  signal  shape  are 
in  phase  while  the  higher  ones  are  not.  The  fluctuation  of 
the  phase  angle  of  the  higher  Fourier  frequencies  is  a def- 
inite indication  that  they  arise  from  noise  in  the  original 
waveform.  In  other  words,  it  is  unlikely  that  Fourier  frequen- 
cies resulting  from  noise  in  the  original  waveform  would  happen 
to  have  the  same  phase  as  the  Fourier  frequencies  resulting  from 
the  signal  (i.e.  the  peak).  Thus,  the  phase  spectrum  provides 
additional  information  about  the  distribution  of  signal  and 
noise  frequencies  in  the  Fourier  domain. 

All  filtering  operations  illustrated  in  this  section 
were  carried  out  on  the  real  part  of  the  transform  (X(J)). 

Thus,  X ( J)  corresponds  to  A(f)  in  Equation  7. 

A Fourier  domain  digital  filter  (B(f)  in  Equation  7) 
that  is  versatile  and  simple  is  a trapezoid.  It  can  be 
characterized  by  four  indices  (N1 , N2  , N3,  N4)  that  define  the 
vertices  of  the  trapezoid  (Betty  and  Horlick,  1976;  Codding  and 
Horlick,  1973a).  Typical  Fourier  domain  digital  filters  that 
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can  be  obtained  by  manipulation  of  the  intoner  values  of  the 
four  indices  arc  shown  in  Figure  13.  The  vertical  dotted 
line  indicates  the  position  of  the  first  point  (OH?'  of  the 
Fourier  domain  siqnal.  Digital  filtering  is  implemented  simply 
by  multiplying  the  Fourier  domain  siqnal  by  the  appropriate 
filter  function.  Signal  points  between  Nl  and  N2  , and  N3  and 
N4  are  multiplied  by  the  "yM  value  of  the  slope,  which  varies 
linearly  between  0 and  1.  Signal  points  between  N2  and  N3  are 
not  altered,  and  those  less  than  Nl  and  greater  than  N4  are  set 
equal  to  zero.  To  implement  a particular  filter  the  operator 
simply  types  in  the  desired  four  indices,  Nl,  N2,  N3  and  N4  at 
the  computer  terminal.  If  Nl  is  zero  and  N2  is  equal  to  1 , a 
filter  such  as  that  shown  in  Figure  13a  results;  whereas  settinq 
Nl  negative  and  N2  positive  (>1)  results  in  the  filter  shown  in 
Figure  13e.  The  remaining  figures  indicate  other  possible  fil- 
ters obtained  by  varying  the  values  of  the  indices. 

Additional  Fourier  domain  digital  filters  can  be  ob- 
tained by  successive  application  of  the  filters  shown  in  Figure 
13.  Successive  application  of  the  filters  shown  in  Figures 
13b  and  13c  results  in  the  filter  shown  in  Fiqure  14a.  Simi- 
larly, the  filter  shown  in  Fiqure  14b  results  from  two  successive 
applications  of  the  filter  shown  in  Fiqure  1 ?e , once  with  N2-N3 
and  the  second  time  with  N3=N4. 

Several  siqnal  processing  operations  can  be  carried  out 
on  spectra  using  these  digital  filters.  The  filter  shown  in 
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Figure  13a  is  used  for  general  purpose  smoothing  ,md  high  l'n- 
c]  uency  noise  el  uo  i iuit  ion  . Diagnosis  of  noise  i n ! o nn< 1 1 1 on  is  of  t < n 
useful  and  can  be  carried  out  using  the  filter  shown  m Figure  Hf. 
Differentiation  can  bo  accomplished  using  the  filters  shown  in 
Figures  13bf  13c,  13d  and  14a  and  deconvolution  can  Lie  approximated 
using  the  filters  shown  in  Figures  13e  and  14b.  These  operations 
are  all  discussed  and  illustrated  in  the  next  section. 

It  should  be  mentioned  here  that  Fourier  domain  correlation 
operations  are  analogous  to  the  apodization  data  handling  step 
of  Fourier  transform  spectroscopy  (Coddinq  and  Horlick,  (1973a). 

In  Fourier  transform  spectroscopy  the  measured  signal  (called  an 
interferograni)  is  analogous  to  the  real  output  of  the  Fourier 
transformation  of  a conventional  spectral  signal  (Figure  12b) . 

Apodization  (digital  filtering)  is  applied  directly  to  the  inter- 
ferogram  before  it  is  transformed  to  the  desired  spectrum. 

R.  SMOOTHING 

Smoothing  is  one  of  the  most  frequent  software  processing 
operations  implemented  on  chemical  signals.  The  basic  aim  of 
smoothing  is  to  improve  the  signal- to-noise  ratio  of  a signal 
thereby  enabling  a more  precise  measurement,  of  the  desired  chemical 
information.  Numerous  approaches  exist  for  implementing  smoothing 
but  most  are  based  on  a direct  application  of  the  correlation  in- 
tegral (Savitzky  and  Golay,  1964)  or  its  Fourier  domain  equiva- 
lent (Horlick,  1972a).  It  was  noted  in  the  .last  section  that  some 
of  the  noise  information  in  the  original  waveform  appears  at  dif-  3 

ferent  Fourier  frequencies  than  does  the  signal  or  peak  information, 
with  the  noise  Fourier  frequencies  dominating  the  upper  or  hiqher  I] 

Fourier  frequencies.  On  the  basis  of  this  different  distribution 

i 
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of  signal  and  noise  information  among  the  Fourier  frequencies,  it 
is  clear  that  a simple  boxcar  truncation  function  can  be  used  as 
a Fourier  domain  noise  reduction  filter.  This  is  shown  in  Figure 
15  which  is  a pictorial  analog  of  Equations  6 and  7.  Note  that 
multiplication  by  the  abrupt  truncation  function  in  the  Fourier 
domain  is  exactly  equivalent  to  direct  correlation  with  the  sine 
function. 

The  filtering  and  diagnosis  of  high  frequency  noise  on  a 
signal  is  illustrated  in  Figure  16.  A spectrum  is  shown  in  Figure 
16a  that  contains  high  frequency  noise,  particularly  on  the 
peaks.  This  noise  was  caused  by  a faulty  power  supply  in  a 
measurement  system.  The  real  part  of  the  Fourier  transform 
of  this  noisy  signal  (Figure  16b)  clearly  reveals  the  presence 
of  excess  high  frequency  noise.  The  Fourier  domain  signal 
shown  in  Figure  16b  is  256  points  long.  Application  of  the 
filter  shown  in  Figure  13a  with  N1=0,  N2-1,  N3=99  and  N4^100 
(trapezoid  indices)  results  in  the  retransformed  spectrum 
shown  in  Figure  16c.  Note  that  the  majority  of  the  high  fre- 
quency noise  has  been  removed  from  the  spectrum. 

From  a diagnostic  point  of  view  is  may  be  useful  to  de- 
termine the  distribution  of  the  noise  in  the  signal  domain. 

This  can  be  accomplished  by  using  a filter  with  indices  equal 
to  99,  100,  255,  256  (see  Figure  l^f ) . result  of  applying 

such  a filter  is  shown  in  Figure  16d,  which  indicates  that  the 

noise  was  concentrated  in  the  region  o^  the  spectral  peaks. 

\ 

Further  examples  of  the  effectiveness  of  Fourier  domain 
digital  filtering  in  removing  high  frequency  noise  components 


oie  shown  in  Figure  17.  The  spectrum  shown  in  Figure  1 con- 
tains an  intense  fixed  frequency  noise  component.  its  trans- 
form (Figure  17b)  indicates  that  the  noise  is  concentrated  at 
about  the  125th  word.  A filter  with  indices  equal  to  0 , 1,  99, 
100  easily  removes  this  narrow-band  high-frequency  noise  com- 
ponent (see  Figure  17c).  Also,  if  desired,  a software  notch 
filter  could  be  set  up  for  noise  of  this  type. 

With  low  level  signals  quantizing  noise  can  become  serious 
as  shown  in  Figure  17d.  Quantizing  noise  has  considerable  high 
frequency  components  as  shown  by  the  transform  of  this  signal 
(Figure  17e)  . Application  of  a digital  filter  with  indices 
equal  to  0,  1,  2,  100  and  retransformation  yields  the  spectrum 
shown  in  Figure  17f,  in  which  the  effects  of  quantization  noise 
are  considerably  reduced. 

The  abrupt  filter  utilized  in  Fiaures  15,  16  and  17  (a, 
b,  c)  may  not  be  the  most  desirable  for  certain  measurements. 

If  some  of  the  signal  information  is  truncated  abruptly,  spur- 
ious side  lobes  will  result.  This  is  shown  in  Figure  18a.  How- 
ever, with  very  noisy  spectra  it  may  be  desirable  to  have  a low 
cutoff  frequency.  This  will,  in  general,  necessitate  the  trun- 
cation of  some  of  the  higher  Fourier  frequencies  that  contribute 
to  the  peak  information  and  as  such  the  ooak  will  be  broadened. 

In  this  case  a smoothing  function  can  be  used  to  minimize  the 
side  lobes  such  as  a linear  truncation  (see  Figures  18b  and 
13a) . The  broadening  of  the  peak  is  often  quite  acceptable 
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and  is  simply  a standard  trade-off  between  signal- to-noise 
ratio  and  resolution. 

Several  other  smoothing  functions  can  be  used  such  as 
Gaussians,  exponentials,  etc.,  and  at  this  point  the  question 
might,  well  be  asked,  "Is  there  a smoothing  function  that  will 
optimize  the  signal-to-noise  ratio  for  peak  height  measurement?" 
Suffice  it  to  say  that  a considerable  amount  of  work  has  been 
reported  in  this  general  area  and  the  characteristics  of  such 
a matched  filter  have  been  established  for  optimal  peak  height 
measurement  (Turin,  1960;  Root,  1970;  Helstrom,  1968;  Ch.unpeney, 
19/4).  When  the  noise  is  white,  the  matched  filter  has  the  shape 
of  the  amplitude  spectrum  of  the  Fourier  frequencies  of  the 
noise  free  signal.  Such  a matched  filter  for  the  peak 
signal  shown  in  Figure  15a  is  shown  in  Figure  18c  along  with 
the  resulting  smoothed  spectrum.  This  operation  amounts  to  cross- 
correlating  a noisy  line  with  a noise-free  version  of  itself. 

This  is  a powerful  correlation  technique  for  peak  detection 
(Horlick,  1973)  and  is  further  illustrated  in  Fiqure  19.  In 
this  case,  the  signal-to-noise  ratio  is  quite  low  (.  2.21  hut 
the  cross-correlation  function  resulting  from  correlation  with 
a matched  filter  clearly  indicates  the  presence  of  the  peak 


signal . 


A major  point  that  often  bothers  many  who 


would  like  to  use  digital  filtering  techniques,  is  the 
question  of  signal  distortion  (Yule,  1972;  Tominaga  et  al , 1972) 
What  must  be  kept  in  mind,  is  that  often  the  goal 
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of  digital  filtering  is  optimization  oi  the  measurement  of  a 
particular'  signal  parameter.  If  the  desired  parameter  is  peak 
height,  as  indicated  above,  then  a so-called  matched  filter 
can  be  used  which,  although  it  distorts  peak  shape  by  broad- 
ening , optimizes  the  signal-to-noi sc  ratio  (peak  hoight/nns 
base  line  noise)  for  peak  height  measurement.  Tf  it  is  also 
desirable  to  preserve  as  well  as  possible  the  observed  line 
shape,  attempt  to  recover  the  "real"  lino  shape  (deconvolu- 
tion) or  optimally  measure  other  peak  parameters  such  as  posi- 
tion, area  or  width  then  specific  digital  filters  must  be  de- 
signed for  this  purpose.  The  optimal  processing  of  the  signal 
for  all  these  parameters  cannot  be  simultaneously  achieved 
using  a single  correlation  (filtering)  operation. 

Clearly  a wide  range  of  Fourier  domain  smoothinq  func- 
tions can  be  utilized  depending  on  the  signal  processing  goals 
of  the  experimentor . Thus  it  is  difficult  to  present  hard  and 
fast  rules  for  determining  the  form  and  extent  of  a Fourier 
domain  smoothing  function.  The  choice  can  be  highly  dependent 
on  the  specific  nature  of  the  signal  and  the  noise,  the  amount 
of  filtering  desired  and  the  degree  of  signal  distortion  that 
can  be  tolerated.  In  particular,  it  may  be  difficult  to  choose 
the  extent  of  truncation.  One  simple  approach  to  this  problem 
is  to  measure,  if  possible,  the  signal  of  interest  under  con- 
ditions that  yield  a high  signal- to-noise  ratio.  Transforma- 
tion of  the  signal  will  result  in  a well  defined  Fourier  spec- 
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trum  and  the  point  beyond  which  little  or  no  signal  information 
is  present  can  easily  be  established. 

Bush  (1974)  has  presented  a quantitative  approach  to  the* 
choice  of  the  truncation  point.  As  noted  early  the  upper  or 
higher  Fourier  frequency  components  are  essentially  due  to 
noise  in  the  original  signal.  In  fact  the  components  are  noise 
like  themselves  in  appearance  and  have  a characteristic  standard 
deviation.  Bush's  method  of  setting  a truncation  point  is  to 
calculate  the  standard  deviation  for  these  upper  Fourier  fre- 
quency components  and  then  successively  repeat  the  calculation 
each  time  including  an  additional  point  from  the  low  frequency 
end.  When  a significant  change  in  the  standard  deviation  is 
noted,  it  can  be  assumed  that  signal  information  has  been  in- 
cluded and  hence,  the  truncation  point  can  be  set. 

Some  of  the  truncation  problems  and  side  lobe  genera- 
tion that  occur  in  Fourier  domain  smoothing  operations  do  so 
because  of  the  nature  of  the  signal.  This  has  been  discussed 
in  the  literature  (Hayes  et  al , 1973)  with  respect  to  filtering 
electroanalytical  data  and  a clever  but  simple  so.lut.ion  pre- 
sented. The  nature  of  the  problem  and  the  solution  are  pre- 
sented in  Figure  20.  The  "original"  signal  is  shown  in  Figure 
20a  and  is  an  exponential  decay.  If  filtered  in  the  Fourier 
domain  directly  (Figures  20b,  c and  d)  signal  distortion  re- 
sults. However,  if  the  original  signal  is  translated  and/or 
rotated  so  that  the  initial  and  final  values  are  zero  before 
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being  filtered  (Figures  20e,  f,  g,  h and  i)  the  introduction 
of  spurious  side  lobes  can  be  avoided. 

C.  DIFFERENTIATION 

Differentiation  of  spectra  is  often  used  to  modify  the  spec- 
tral information.  The  first  derivative  of  a spectral  peak  is  used  as 
an  aid  in  exact  peak  location  (Morrey,  1968;  Walters  and  Malmstadt, 
1966)  and  higher  derivatives  are  used  for  peak  sharpening  i.e. 
resolution  enhancement  (Martin,  1959;  Allen  et  al,  1964).  The  deriv 
ative  theorm  of  the  Fourier  transforms  (Bracewell , 1965)  states  that 
if  the  imaginary  part  of  the  Fourier  transformation  of  a function 
is  multiplied  by  a linear  ramp  starting  at  the  origin  the  re- 
sult is  the  real  part  of  the  Fourier  transformation  of  the  de- 
rivative of  the  original  function.  In  other  words,  the  imag- 
inary part  is  multiplied  by  f.  This  is  summarized  by  Equation 
12. 


a (t) 


a'  (t) 


FOURIER 

TRANSFORMATION 


INVERSE 

FOURIER  (12) 

TRANSFORMATION 


A (f ) x f 


f 'A(f) 


Multiplication  by  this  linear  ramp  function  in  the  Fourier 
domain  eliminates  the  dc  level  and  attenu  tes  low  Fourier  fre- 
quencies with  respect  to  high  Fourier  frequencies.  It  simply 
amounts  to  a high  pass  digital  filter.  The  accentuation  of 
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hiqh  Fourier  frequencies  is  u well  known  characteristic  of  .t 
differentiation  step  (Stauffer  and  Sakai,  The  accentu- 

ation should  not  be  carried  out  beyond  the  point  at  which  the 
signal  Fourier  frequencies  disappear  or  else  the  resulting 
derivative  will  be  very  noisy.  Thus,  some  low  pass  digital 
filtering  of  the  Fourier  frequencies  should  always  be  used  in 
conjunction  with  differentiation.  This  is  directly  analogous 
to  techniques  used  in  the  design  of  analog  differentiating 
circuits  using  active  filters.  In  addition,  as  with  analog 
differentiation,  the  quality  of  the  differential  is  dependent 
upon  the  high  and  low  frequency  cutoffs  relative  to  the  signal 
frequencies . 

Such  a Fourier  domain  diqital  filter  can  easily 

V. 

be  set  up  usinq  the  trapezoid  function  as  shown  in  Figure 
13b.  The  effect,  of  such  a digital  differentiating  filter  on 
a spectrum  is  illustrated  in  Figure  21.  The  original  spectrum 
is  a doublet  and  is  shown  in  Figure  21a.  The  Fourier  domain 
differentiating  filter  is  shown  in  Figure  21b  and  it  was  applied 
in  a manner  analogous  to  that  depicted  in  Figure  15.  Note  that 
both  high  and  low  pass  filtering  are  readily  carried  out  in  one 
simple  multiplication  step.  The  resulting  first  derivative 
spectrum  is  shown  in  Figure  21c.  The  first  derivative  is  per- 
haps of  minimal  used  in  processing  peak  type  signals  although 
it  has  found  application  in  detecting  peak  locations  vising  its 
zero  crossing.  However,  if  the  filter  shown  in  Figures  13b  and 

1 
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and  21b  is  applied  instead  to  the  reaZ  part  of  the  rourier 
transform  of  the  signal  and  the  resulting  function  (which  now 
is  the  imaginary  part  of  the  Fourier  transform  of  the  first 
derivative  of  the  signal)  is  retransformed,  a resolution  en- 
hanced signal  is  obtained.  This  is  illustrated  in  Figure  22, 
in  which  the  real  part  of  the  Fourier  transform  (Figure  22b) 
of  the  spectral  signal  shown  in  Figure  22a  is  multiplied  by 
the  digital  filter  shown  in  Figure  13b  with  indices  equal  to 
1,  125,  125,  250.  Note  that  the  signals  and  transform  in 
Figure  22  are  all  512  points  long.  The  resulting  resolution 
enhanced  signal  is  shown  in  Figure  22c. 

Higher  derivatives  can  easily  be  obtained  by  successive 

application  of  this  filter.  A second  derivative  is  obtained 

2 

by  multiplying  in  the  Fourier  domain  by  f , i.e.: 

a(t)  a"  ( t) 

FOURIER  INVERSE 

FOURIER  (13) 

TRANSFORMATION  TRANSFORMATION 

A ( f ) x f2  f 2 . A ( f ) 

The  form  of  the  second  derivative  Fourier  domain  filter  is  shown 
in  Figure  14a.  As  with  the  first  derivative^ low  pass  filtering 
is  necessary  to  control  noise.  This  filter  may  be  achieved  by 
two  successive  applications  of  the  filters  shown  in  Figures  13b 
and  13c.  It  has  also  been  found  that  very  similar  results  can  be 
obtained  with  the  filter  shown  in  Figure  13d  (Betty  and  Horlick, 
1976)  . 
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Second  differentiation  is  a powerful  technique  for  resolu- 
tion enhancement.  An  example  presented  by  Kelly  and  Horlick 
(1974)  is  shown  in  Figure  23.  The  signal  in  a noisy  Lorentzian 
doublet.  The  composition  of  the  doublet  is  shown  in  Figure  23a 
and  the  actual  noisy  signal  upon  which  the  second  derivative 
resolution  enhancement  operation  was  performed  in  shown  in  Figure 
23b.  The  result  is  shown  in  Figure  23c  and  indicates  the  excel- 
lent resolution  enhancement  possible  with  a relatively  simple 
Fourier  domain  correlation  operation. 

D.  DECONVOLUTION 

In  the  introduction  it  was  mentioned  that  convolution 
(Equation  5)  could  be  used  to  describe  the  effect  of  an  instru- 
ment on  a signal.  It  is  often  desirable  to  remove,  if  possible, 
the  effects  of  such  a convolution  from  a signal.  Procedures  for 
reversing  the  convolution  operation  are  generally  referred  to  as 
deconvolution.  Various  deconvolution  procedures  have  been  widely 
used  to  process  signals.  An  early  paper  by  Bracewell  and  Roberts 
(1954)  dealing  with  applications  to  radio  astronomy  is  an  excel- 
lent introduction  to  deconvolution  methods.  Numerous  other 
authors  have  studied  deconvolution  methods  (Jones  et  al,  1967; 
Jansson  et  al,  1968;  Dromey  and  Morrison,  1970;  Izatt,  1969; 
Moore,  1968;  Saksena,  1968;  Vladimeroff,  1971;  Szoke,  1972; 
Horlick,  1972b;  Brouwer  and  Jansen,  1973;  Stockham  and  Cannon, 
1975).  The  last  authors  (Stockham  and  Cannon,  1975)  present  a 


- 32  - 


so-called  blind  deconvolution,  useful  in  situations  where  it 
is  either  difficult  or  impossible  to  know  or  measure  the  instru- 
ment response  function.  They  have  applied  their  technique  to 
the  deconvolution  of  early  Caruso  recordings  and  blurred  photo- 


graphs . 


As  with  correlation,  convolution,  in  the  Fourier  domain 


can  be  described  as  a simple  multiplication  analogous  to  Equa- 


tion 7 : 


A(f ) x B ( f ) = C(f) 


where  A(f) , B(f)  and  C(f)  represent  the  Fourier  transforms  of 
the  real  signal  a(t),  the  instrument  response  function  b(t) 
and  the  observed  signal  c(t).  Deconvolution  is  simply  a division 
operation  in  the  Fourier  domain  which  attempts  to  reverse  the 
convolution  operation.  It  can  be  represented  as: 

A°(f)  = C(f)AB/B(f)  (14) 

where  A°(f)  is  the  Fourier  transform  of  the  deconvolved  siqnal. 
The  complete  deconvolution  process  can  be  outlined  as: 


a°  (t) 


FOURIER 


TRANSFORMATION 


INVERSE 
FOURIER  (15) 
TRANSFORMATION 


C(f) 


1/B ( f ) 


A°  (f) 


where  c(t)  is  the  observed  siqnal  and  a°  (t)  the  deconvolved  sig- 
nal. It  is  very  important  to  note  that  the  convolution  operation 
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is  not,  in  general  reversible  i.e.  a°(t)  -f  a(t).  This  point 
has  been  discussed  in  the  literature  (Bracowoll  and  Roberts, 
1954;  Rautian,  1958;  Horlick,  1972b). 

It  is  clear  from  Equation  15  that  deconvolution  is  simply 
a standard  cross-correlation  operation.  It  can  be  thought  of 
as  a Fourier  domain  digital  filtering  operation  with  a rather 
specialized  filter  function  which  is  the  reciprocal  of  the 
Fourier  Transform  of  the  instrument  response  function. 

A common  application  area  for  deconvolution  is  spectro- 
scopy, In  spectroscopy,  the  signal  is  the  spectrum  which  is 
to  be  measured  and  the  instrument  response  fvinction  is  the 
resolution  function  which  is  frequently  determined  by  the  slit 
width  (Figure  5) . In  many  cases  the  response  function  can  be 
determined  by  measuring  the  profile  of  a narrow  line  (Horlick, 
1972b) . Such  a measured  line  profile  and  its  Fourier  transform 
are  shown  in  Figure  24.  Thus  the  deconvolution  Fourier  domain 
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digital  filter  is  simply  the!  reciprocal  of  the  function  shown 
in  Figure  24b.  I 

However,  the  reciprocal  of  this  function  becomes  very 
large  at  higher  Fourier  frequencies  and  deconvolution,  as  with 
the  case  of  differentiation,  can  accentuate  the  high  Fourier 
frequencies  to  such  an  extent  that  noise  will  obscure  the  de- 
convolved signal.  The  solution  to  this  problem  is  to  combine 
some  low  pass  filtering  with  deconvolution . Thus,  a Fourier 
domain  deconvolution  filter  has  a form  such  as  that  shown  in 
Figure  25.  Note  that  it  is  not  unlike  the  second  derivative 
digital  filter.  An  example  of  the  resolution  enhancement  that 
can  be  achieved  with  such  a controlled  deconvolution  is  shown 
in  Figure  26  (Kelly  and  Horlick,  1974).  The  original  spectrum 
was  that  shown  in  Figure  23b. 

Finally  it  is  possible,  usinq  filters  such  as  those 
shown  in  Figures  13e  and  14b  to  approximate  deconvolution  resol- 
ution enhancement  techniques.  The  main  value  of  these  filters 
for  resolution  enhancement  (as  compared  to  differentiation 
methods)  is  that  with  less  attenuation  of  the  low  Fourier  fre- 
quencies, there  is  less  generation  of  negative  sidelobes. 

These  examples  illustrate  the  pow<  and  ease  of  Fourier 
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domain  digital  filtering.  With  the  simple  functions  shown  in 
this  section  a large  number  of  sophisticated  sianal  processing 
operations  can  readily  be  carried  out.  In  addition,  an  impor- 
tant aspect  of  Fourier  domain  correlation  operations  is  that 
it  is,  in  most  cases,  considerably  easier  to  design  a digital 
filter  in  the  Fourier  domain  than  it  is  in  the  signal  domain. 

For  example,  the  form  of  a Fourier  domain  notch  filter  is 
intuitively  clear  from  Figure  17b  while  the  form  of  a notch 
filter  that  could  be  directly  applied  to  the  signal  (Figure 
17a)  via  the  convolution  equation  (Equation  1)  is  not  readily 
apparent.  Thus,  the  Fourier  domain  approach  to  digital  fil- 
tering considerably  enhances  an  experimenters  capability  in 
developing  unique  digital  filters  for  specific  signal  processing 
needs . 

In  conclusion,  the  comment  made  about  sianal  distortion 

r 

. towards  the  end  of  the  smoothing  section  can  be  reiterated 
here.  fn  contrast  to  smoothing  operations,  the  goal  of  resolu- 
tion enhancement  is  optimization  of  the  measurement  of  peak 
position.  This  is  often  achieved  by  derivative  and  deconvolution 
techniques  such  as  those  illustrated  here  that  generate  narrower 

spectral  peak  shapes,  at  times  wiYh  significant  distortion  of 

v 

^ the  peak  shape,  in  order  to  optimize  'the  precision  of  peak 

\ 

position  measurement.  In  addition,  resolution  enhancement  is 

usually  achieved  at  the  expense  of  amplitude  signal-to-noise 

. \ 

ratio.  However,  as  mentioned  before  op ti ma processing  of  the 


i 


A 


36 


spectral  information  for  both  peak  height  and  peak  position 
cannot  be  simultaneously  achieved  using  a single  filtering 
operation.  Realization  of  this  important  concept  facilitates 
intelligent  and  effective  utilization  of  correlation  based 
digital  filtering  technique?. 

E . SIGNAL  DETECTION 

Correlation  is  often  a useful  preprocessing  step  in  a siaral 
detection  operation  (Black,  1969).  If  two  signals  are  composed  of 
peaks,  a relatively  large  value  of  the  correlation  function 
at  t = 0 is  a strong  indication  that  the  two  signals  are  similar 
(See  Figure  19).  In  a sense,  the  correlation  operation  is  a 
way  of  concentrating  the  information  about  the  similarity  of 
two  signals  into  the  magnitude  of  a sincrle  point.  Even  the 
smoothing  aspect  of  correlation  discussed  earlier  can  be  looked 
at  from  |;he  point  of  view  of  signal  detection,  i.e.  finding  or 
detecting  a peak  in  a noisy  base  line.  For  example,  correlation 
techniques  have  been  developed  to  a high  degree  of  sophistica- 
tion for  the  detection  of  radar  signals  (Root,  1970). 

A simple  example  of  the  signal  detection  aspect  of  correl- 
ation (Malmstadt  et  al,  1974)  is  presented  in  Fiaure  27.  The 
signal  (Figure  27a)  is  a sequence  of  bin.-  v pulses  and  the  reference 
is  a triplet  sequence  (Figure  27b).  The  cross-correlation  function 
between  the  two  waveforms  is  shown  in  Figure  27c.  The  maxima  in 
the  cross-correlation  function  indicates  positions  on  the  signal 

■ 

where  signal  information  most  like  the  reference  waveform  is  to 

be  found. 
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The  application  of  cross-correlation  techniques  to  the 
identification  of  spectra  patterns  is  shown  in  Figures  28  and  29 
(Horlick,  1973).  Emission  spectra  of  Co,  Ni  and  Fe  in  the  region 

e 

of  3430  to  3500  A are  shown  in  Figure  28.  Consider  the  Co  spec- 
trum as  the  sought-for  spectral  information.  The  Co,  Ni  and  Fe 
spectra  were  cross-correlated  with  the  Co  spectrum.  The  re- 
sulting cross-correlation  functions  are  shown  in  Figure  29. 

Figure  29a  is  the  cross-correlation  function  of  the  Co  spectrum 
with  itself  and  in  this  case  it  can  more  accurately  be  called 
an  autocorrelation  function.  The  pattern  has  a relatively  large 
maximum  at  x = 0 indicating  that  the  two  spectra  as  expected 
have  common  spectral  features.  The  rest  of  the  function  con- 
tains information  about  relative  peak  separations  but  unless 
the  original  spectra  are  quite  simple,  this  information  is  not 
readily  interpretable . Also,  since  this  pattern  represents 
an  autocorrelation,  it  is  symmetrical  about  x = 0. 

The  Co  spectrum  was  then  cross-correlated  with  the:  Ni 
spectrum  and  Fe  spectrum.  The  resulting  cross-correlation 
functions  are  shown  in  Figures  29b  and  29c.  These  functions 
show  no  distinct  maximum  at  x = 0 indicating  that  the  two 
spectra  in  each  case  share  little  similar  spectral  information. 

In  addition,  no  symmetry  is  associated  with  the  cross- 
correlation function.  However,  a complex  pattern  is  still  pre- 
sent as  peaks  overlap  and  coincide  as  the  spectra  are  shifted 
relative  to  each  other.  All  the  cross-correlation  functions 


• h*M*n  In  Fiqure  2 s have  the  same  vertical  axis  of  sensitivity 
thus,  in  this  example,  the  behavior  of  the  cross -correlation 
pattern  at  t - 0 allows  the  identification  of  the  Co  spectrum 
in  the  measured  set  of  spectra. 

It  should  be  noted  that  many  learning  machine  approaches 
to  pattern  recoqnition  use  a similar  preprocessing  step.  The 
unknown  pattern  is  multiplied  point  by  point  by  a specific 
vector  and  then  the  products  are  summed  to  obtain  a number  upon 
which  a decision  can  be  made  about  the  identification  of  the 
pattern  (Jurs  et  al , 1969).  This  is,  of  course,  identical  to 
the  operation  involved  in  evaluating  the  magnitude  of  the  t *•  0 
point  in  the  cross -correlation  function.  In  addition,  an  AND- 
sum  operation  has  been  found  useful  in  identifying  binary  pat- 
terns derived  from  spectra  (Crotch,  1^70;  Codding  and  Mori irk, 
1973b).  This  operation  involves  evaluating  the  logical  AND- 

operation  between  two  binary  patterns  and  then  summing  the  re- 

« 

suiting  logical  "ones”  and  hence  is  a binary  analog  of  correl- 
ation . 


III.  CORRELATION  RACED  SIGNAL  GENERATION^ OPERATIONS 

The  correlation  operation  Is  ubiquitously  present  when- 
ever chemical  signals  are  generated  or  measured.  The  intimate 
connection  of  correlation  and  convolution  takes  this  clear  as 
any  measured  signal  is  the  convolution  of  the  ''real"  signal 
with  the  instrument  response  function.  Also,  a number  of  common 
hardware  based  signal  processing  techniques  that  are  applicable 


to  the  measurement  of  a rather  large  number  of  chemical  param- 
eters can  be  considered  as  correlation  based  techniques.  These 
include  the  lock-in  amplifier  and  boxcar  integrator  whose  cor- 
relation nature  has  been  discussed  in  some  detail  in  the  liter- 
ature (Hieftje,  1972a;  Hieftje,  1972b;  Malmstadt  et  al,  1974). 

However,  in  recent  years,  a number  of  measurement  tech- 
niques have  been  developed  where  the  correlation  operation  is 
more  explicitly  involved  in  the  signal  generation  and  measure- 
ment steps.  A number  of  these  measurements  will  be  described 
in  this  section  to  provide  the  reader  with  a feel  for  the  nature 
and  utility  of  correlation  based  measurement  techniques.  Cor- 
relation techniques  have,  of  course,  been  applied  to  a number 
of  areas  other  than  those  high-lighted  here.  The  coverage 
here  is  not  meant  to  be  exhaustive  but  simply  representative. 
Several  additional  examples  are  also  presented  in  Section  IV 
where  work  of  a more  instrumental  nature  and  emphasis  is  dis- 
cussed. 

A.  SHOT  NOISE  AUTOCORRELATION  MEASUREMENT  TECHNIQUE  FOR 
PHOTOCURRENTS . 

The  output  photocurrent  from  a photomultiplier  tube  is 
not  constant  but  rather  fluctuates  due  to  the  quantum  nature 
of  light.  These  fluctuations  are  general  y termed  shot  noise. 

In  a conventional  dc  measurement  system,  the  output  photo- 
current is  low  pass  filtered  to  minimise  the  intensity  of  the 
shot  noise  and  the  dc  level  of  the  current  is  taken  as  a measure 
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of  the  liqht  intensity.  Pao  et  al.,  (1966)  and  Pao  and  Griffith.*; 
(1967)  have  indicated  that  at  low  light  levels  and/or  wide 
measurement  bandwidths,  there  may  bo  more  signal  power  in  the 


shot  noise  component  of  the  photocurrent  than  in  the  dc  cc 


ponent.  Furthermore,  since  the  amplitude  of  the  shot  noise 


varies  as  the  square  root  of  the  signal  level,  the  averaqo  value 
of  the  square  of  the  shot  noise  component  (shot  noise  power) 
should  be  linearly  related  to  light  intensity.  The  measure- 


ment of  this  value  can  be  achieved  by  autocorrelation 


of  the  output  shot  noise  from  the  PM  tube  with  the  value  at 


T = 0 equal  to  the  desired  shot  noise  power.  A number  of 


workers  have  successfully  used  this  technique  for  the  measure- 


ment of  photocurrents  (Griffiths,  1967;  Cleary,  1967;  Griffiths 
and  Pao , 1967;  Alfano  and  Ockman , 1968;  Anderson  and  Cleary, 


1970)  . 


The  instrumentation  for  this  autocorrelation  measurement 


is  quite  simple.  All  that  is  needed  is  an  analog  multiplier 


with  a low  pass  filtered  output.  A measurement  system  that 


has  been  successfully  utilized  for  this  ujtocorrel  at  ion  i s shown 


in  Figuro  <0.  Tho  analog  multiplier  unit  used  to  square  the 


signal  was  a PAR  Model  2^0  and  it  has  a low  pass  filtered  out- 


put. Other  analog  multipliers  such  as  Analog  Pevioes  426A 


could  also  be  used. 


The  linearity  of  the  shot  no*. so  autocorrelat ion  measure- 


ment system  is  shown  in  Figure  11.  The  output  of  the  multiplier 
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unit  is  plotted  on  a loq-log  plot  vs  the  dc  photocurrcnt  as 
measured  with  a conventional  system.  The  slope  of  this  plot 
is  45°  indicating  that  the  multiplier  output  varies  linearly 
with  photocurrent  and  hence  is  linearly  dependent  on  the  in- 
cident light  level. 

R.  APPLICATION  OF  CORRELATION  TECHNIQUES  IN  FLAME  SPECTROMETRY . 

A number  of  signal-to-noise  ratio  enhancement  tech- 
niques have  been  applied  to  flame  spectrometric  measurements 
including  tuned  amplification,  lock-in  amplification,  signal 
averaging,  dc  integration,  boxcar  integration  and  photon 
counting,  some  of  which  as  mentioned  above,  can  be  considered 
as  correlation  techniques.  However,  more  recently,  an  explicit 
cross-correlation  technique  has  been  applied  to  flame  spec- 
trometry for  the  purpose  of  signal-to-noise  ratio  enhancement 
(Hieftje  et  al,  1973b) . 

The  cross-correlation  technique  was  applied  to  atomic 
fluorescence  spectrometry.  The  intensity  of  the  primary  light 
source  (a  rhodium  hollow  cathode  lamp)  was  sinusoidally  modu- 
lated utilizing  a programmable  power  supply.  The  photocurrent 
resulting  from  the  atomic  fluorescence  of  rhodium  was  cross- 
correlated  (Model  3721A  Hewlett-Packard  Correlator)  with  the 
sine  wave  reference  used  to  modulate  the  - mp  intensity.  Cross- 
correlation was  compared  to  lock-in  amplification  and  the  limit 
of  detection  for  rhodium  was  0.16  ppm  using  the  correlator  and 
0.91  ppm  using  lock-in  amplification.  Also,  it  was  shown  that 
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the  cross-correlation  technique  was  particularly  superior  in 
the  presence  of  significant  amounts  of  impulse  noise.  'This  in 
illustrated  in  Fiqures  12  and  33. 

In  this  study,  impulse  noise  was  simulated  by  striking 
a brief  spark  from  a Tesla  coil  to  the  grounded  photomultiplier 
housing.  In  Figure  32  if  is  seen  that  'arae  excursions  are 
produced  in  the  output  of  the  lock-in  amplifier  whenever  an  im- 
pulse (marked  by  arrows)  occurs.  The  correlator  output  shown 
in  Figure  33  is  considerably  less  susceptible  to  impulse  noise. 
The  impulse,  which  still  caused  deviation  in  the  output  signal, 
can  now  be  simply  discarded  as  being  obviously  deviant  from  the 
otherwise  smooth  sinusoidally  varying  cross-correlation  function. 
Both  the  lock-in  amplifier  and  correlation  measurements  were 
made  using  a 100  ppm  rhodium  solution. 

Cross-correlation  techniques  have  also  been  used  by 
Hieftje  et  al,  (1973a)  in  a study  of  source  modulation  waveforms 
for  improved  signal-to-noise  ratio  in  atomic  absorption  spec- 
trometry- in  this  case  sine  wave,  square  wave,  ripple,  pulse, 
and  pseudo-random  pulse  modulations  of  the  source  intensify 
were  studied.  The  demodulation  step  in  order  to  generate  the 
output  signal  can,  in  all  cases,  be  interpreted  as  a single 
point  cross-correlation  with  zero  delay  ‘arforth,  1970; 

Malmstadt  et  al,  1974). 

C . SYSTEM  CHARACTERIZATION  USING  CORRELATION  METHODS . 

There  are  a number  of  scientific  measurements  and  studies 
that  necessitate  the  characterization  of  the  frequency  response 
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°f  a system.  Correlation  techniques  utilizing  random  input, 
waveforms  arc  beginning  to  revolutionize  these  measurements. 

In  order  to  understand  how  correlation  techniques  enable  the 
characterization  of  a system,  we  must  digress  a bit.  bet  us 
imagine  the  system  that  we  wish  to  investigate  is  a "black 
box"  which  has  an  input  which  enables  us  to  perturb  it,  and 
an  output  which  enables  us  to  observe  the  effect  of  the  per- 
turbation. Our  purpose  will  now  be  to  determine  a relation- 
ship between  the  input  and  output  of  the  "black  box"  which 
will  enable  us  to  characterize  its  frequency  response.  The 
nature  of  the  frequency  response  can  often  then  be  used  to 
study  important  physical,  biological  or  chemical  parameters 
of  the  system  contained  in  the  black  box. 

One  method  of  characterization  that  has  long  been  studied 
and  employed  by  workers  in  various  fields  is  to  determine  the 
transfer  function  of  the  "black  box".  While  the  details  of 
the  transfer  function  need  not  concern  us  here,  one  kind  of 
transfer  function  is  particularly  useful  --  the  impulse  res- 
ponse function.  The  impulse  response  function  is  merely  the 
output  that  our  system  would  produce  if  perturbed  with  an  in 
put  consisting  of  an  impulse,  that  is,  a very  sharp  spike. 

From  Fourier  transform  considerations  (Bracewe  1 1 , 


it  is  known  that  an  ideal  "infinitely  fa  .t"  impulse  has  a flat 
frequency  spectrum,  i.c.  contains  all  frequencies.  Therefore, 
perturbing  our  black  box  with  the  impulse  is  equivalent  to 
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simultaneously  Bonding  nil  frequencies;  into  tin-  input 
Under  these  conditions,  the  output  or  the  block  box  will  con- 
tain all  frequencies,  but  some  will  have  been  attenuated , dis 
torted,  phase  shifted,  or  altered  in  some  other  way  by  the 
system.  In  short,  the  impulse  response  function  i?  effectively 
a time  domain  representation  of  the  frequenev  response  ot  the 
system.  As  such,  Fourier  analysis  of  the  impulse  response 
function  is  frequently  utilized  to  further  aid  ch.n  acterizo- 
tion  of  the  system. 

In  addition  to  the  impulse  response  function,  the  step 
response  function  can  also  be  used  in  a somewhat  similar  fashion 
and  this  was  illustrated  in  Figure  11  as  an  example  of  convolu- 
tion. Thus  the  impulse  response  function  is  simply  the  convolu- 
tion of  the  input  impulse  with  the  system  response  function. 
However,  the  correlation  operation  can  be  advantageously  employed 
in  a more  explicit  way  for  the  determination  of  the  impulse 
response  function  of  a system. 

Recall  Figure  7,  in  which  the  autocorrelation  of  a random 
function  was  shown  to  produce  a sharply  peaked  function  centered 
at  t - 0.  The  impulse  is  therefore  morels  a phase  i elated 
representation  of  the  random  waveform.  Because  of  this  relation- 
ship, perturbing  the  black  box  with  a random  wave  should  oeneiate 
an  output  equivalent  in  frequency  content  to  that  produced  by  an 
impulse  perturbation.  The  random  waveform,  like  the  impulse, 
contains  all  frequencies,  although  all  are  not  being  sent  simul- 
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taneously  into  the  system.  The  output  of  the  system  also  con- 
tains all  these  frequencies  altered  as  described  before  for 
the  impulse  input.  It  is  much  ro  ~e  difficult  to  characterize 
these  alterations,  i.e.  visually  discern  the  inq.  ilse  response 
of  the  system,  in  the  apparently  random  output  waveform.  The 
key,  however,  is  simply  to  cross-correlate  the  output  wavefor-ra 
from  the  system  with  the  random  input  which  will  produce  the 
desired  impulse  response  function  (Hewlett-Packard,  1969)  . Th*s 
process  is  illustrated  in  Figure  34. 

From  the  foregoing,  it  is  evident  that  an  impulse  re- 
sponse function,  useful  in  characterizing  a device,  can  be  gener- 
ated using  either  an  impulse  or  a random  function  as  an  input 
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signal.  The  important  consequence  of  this  observation  is  that, 
with  a random  waveform,  the  frequency  components  being  used 
to  perturb  the  device  can  be  spread  out  over  a long  period  of 
time,  thereby  avoiding  the  sudden,  intense  perturbation  created 
by  an  impulse.  Because  the  "black  box"  need  only  accept  a 
small,  fraction  of  the  total  combined  amplitude  of  all  frequency 
components  at  any  given  time,  the  amplitude  of  each  component 
can  be  increased  manyfold,  and  a clearer,  more  noise-free  record 
of  the  impulse  response  function  be  obtained.  Thus  the  random  in- 
put, cross-correlation  approach  to  system  characterization  is  very 
powerful.  Its  wide  spread  usage  has  been  somewhat  hampered  by  lack 
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of  convenient  i on  I’lation  inutru"'  nt.it  . o i t * vi t the  ..ppcar.incc  of 
commercial  correlators  is  beginning  t > make  it  the  method  of 
choice.  A wide  ranqe  of  mechanical,  electrical,  biological, 
acoustrical  and  chemical  systems  have  been  studied  by  th’s 
technique.  As  a simple  example,  consider  the  black  box  to  be 
a large  motor . In  this  case  the  input  to  the  motor  would 
merely  be  the  current  to  the  motor's  windings,  'he  output  would 
be  an  observed  rotation  of  a motor.  Information  about  the 
relationship  between  these  two  quantities  would,  of  course,  be 
interest  to  an  engineer  wishincr  to  employ  the  motor 
in  a specific  application.  However,  it  would  be  highly  undesir- 
able to  excite  the  motor  with  an  impulse,  because  at  the  very 
least,  it  is  likely  that  the  motor's  windings  would  be  damaged 
by  this  sudden  application  of  a large  current.  Instead, 
the  engineer  can  apply  a randomly  varying  current  to  the  motor 
and  observe  and  correlate  the  slight  variation  in  output 

rotation  rates  which  are  produced.  In  this  application,  an 
additional  advantage  derived  is  that  the  motor  can  be  observed 
undei^  normal  operating  conditions,  that  is,  while  it  is  rotating. 

Among  the  more  prominent  chemical  applications  of  this 
technique  are  Fourier  transform  NYR  methods  and  characterization 
of  electrode  processes. 

1.  Fourier  Transform  NMR 


It  is  clear  that  Fourier  transform  methods  (Farrar,  1970) 


' 
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h.ivc  revolutionised  nuclear  magnetic  losonume  sprcl  luiirtry. 

IL  is  not  out  intention  here  to  in  any  way  rcviv'w  tit  in  wi\ 
large  field,  but  simply  to  indicate  how  the  teehnigui  lelates 
to  correlation  methods.  As  first  implemented  (i-anst  and 
Anderson,  1966),  a pulse  ot  radio-frequency  energy  was  used 
to  excite  the  free  induction  decay  characteristic  of  nuclear 
spin  relaxation.  In  effect , the  free  induction  decay  signal 
is  merely  a special  form  of  impulse  response  function  which, 
upon  Fourier  transformation,  yields  the  desired  spectrum. 

More  recently,  it  has  been  shown  by  Ernst  (1970)  and  others 
(Kaiser,  1970)  that  application  of  the  radio  frequency  energy 
in  a random  fashion  (stochastic  excitation)  and  subsequent 
cross-correlation  can  produce  even  better  signal  character- 
istics. In  particular,  because  the  instantaneous  power  of 
the  randomly-applied  radio  frequency  signal  can  be  much  lower, 
the  average  power  can  be  much  higher  without  producing  nuclear 
saturation.  This  higher  average  power  in  turn  provides  higher 
signal-to-noise  ratios  in  the  final  detected  siqnal  or  allows 
reduction  in  the  amount  of  time  necessary  to  obtain  an  NMR 
spectrum  at  any  desired  signal-to-noise  ratio.  A related  tech- 
nique, although  not  strictly  a correlation  method,  is  Fourier 
synthesized  excitation  (Tomlinson  and  Hill,  1973'  in  which  the 
input  excitation  pulse  contains  only  a se.ccted  number  of  fre- 
quencies. 
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2.  Electrochemical  Systems 


A number  of  workers,  using  techniques  similar  to  those 
discussed  above  for  Fourier  transform  NMP,  have  studied  and 
characterized  electrochemical  systems.  This  has  included  im- 
pulse methods  (Biike,  1971),  Fourier  syntheses  techniques 
(Kojima  and  I'ujiwara,  1971;  Creason  and  Smith,  1977a;  Ciouson 
and  Smith,  1973;  Glover  and  Smith,  1973)  and  the  application 
of  random  and  pseudo-random  noise  as  applied  potential  signals 
(Creason  and  Smith,  1972b). 

D . CORRELATION  ANALYSIS  OF  NOTSE-"FLUCTUATION  SPECTROSCOPY " 

In  recent  years,  a number  of  new  and  unique  scientific 
measurements  have  been  carried  out  that  are  based  on  the  correl- 
ation analysis  of  noise.  The  first  measurements,  and  the  ma- 
jority to  date,  have  involved  the  analysis  of  scattered  laser 
light  by  autocorrelati ng  intensity  fluctuations.  More  recently 
noise  correlation  methods  have  also  been  applied  to  the  measure- 
ment of  chemical  kinetic  information  using  fluorescence  and 
conductivity  fluctuation  measurements.  This  is  an  exciting  and 
rapidly  developinq  field  and  we  will  briefly  review  it  in  this 
section . 

An  early  review  on  the  subject  o,  \tilizing  the  measure- 
ment of  light  fluctuations  as  a spectroscopic  tool  was  presented 
by  Wolf  in  1964  (Wolf,  1965).  In  particular,  it  is  possible  to 
measure  spectral  information  about  the  line  width  of  a laser  line 


and/or  i Doppler  broadened  Rayleigh  scattered  laser  line  by 
autoco*- relating  intensity  fluctuations.  As  the  technique  has 
evolved,  a host  of  names  have  become  associated  with  it,  among 
them:  1 iqht  beating  spectroscopy,  photon  correlation  spectro- 
scopy, heterodyne  laser  beat  frequency  spectroscopy,  optical 
mixing  spectroscopy,  intensity  correlation  spectroscopy,  inten- 
sity fluctuation  spectroscopy , and  laser  Doppler  spectroscopy. 
Review:,  of  the  field  have  been  presented  by  Cummins  and  Swinney 
(1970)  and  Berne  and  Pecora  (1974)  and  Cummins  and  Pike  (1974) 
have  edited  a recent  volume  devoted  to  Photon  Correlation  and 
Light  Heating  Spectroscopy. 

At  present,  the  largest  application  of  this  technique  is 
in  the  measurement  of  flow  and  flow  related  parameters  such  as 
diffusion  coefficients  with  most  effort  centered  on  biochemical 
systems.  A typical  experiment  involves  the  measurement  of  the 
time-vrtyinq  scattered  radiation  (intensity  fluctuation)  from  a 
flowing  system  being  illuminated  by  a powerful  argon  ion  laser. 
Autoco 'relation  of  these  intensity  fluctuations  in  the  scattered 
siqnaJ  jan  provide  information  about  the  flowing  system.  In  a 
recent  experiment,  (Ware  and  Flygare,  1971)  simultaneous  measure- 
ment of  electrophoretic  mobility  and  the  diffusion  coefficient 
of  bovine  serum  albumin  was  carried  out  utilizing  such  light 
scattering  techniques.  Since  that  time,  there  have  been  many 
applications  of  this  technique  to  flow  related  measurements. 

Among  chem,  a further  study  by  Ware  and  Flygare  (1972)  applied  to 
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fibrinogen,  a study  of  electrokinetic  phenomena  (Uzgiris,  1972; 
Uzgiris , 1974),  blood  flow  (Tanaka  and  Benedek , 1975),  plasmas 
(Ogata  and  Matsuura,  1974),  air  flow  (Durrani  and  Greated,  1975) 
and  macromolecular  diffusion  coefficients  (Pusey  et  al , 1974). 

A full  review  of  this  rapidly  expanding  field  is  beyond  the 
scope  of  this  chapter.  However,  the  interested  reader  is  en- 
couraged to  review  the  original  publications  as  many  applications 
are  certainly  of  chemical  interest. 

Very  recently,  noise  correlation  methods  have  been  ex- 
tended to  the  measurement  of  chemical  kinetic  parameters  util- 
izing fluorescence  and  conductivity  fluctuations.  Fluores- 
cence correlation  spectroscopy  has  been  discussed  in  some  detail  by 
Magde  et  al , (1972),  Elson  and  Magde  (1974)  and  Magde  et  al.  (1974). 
Feher  and  Weissman  (1973)  have  determined  the  kinetic  parameters 
of  the  dissociation  reaction  of  beryllium  sulfate  by  correlation  of 
conductivity  fluctuations.  Chen  (1973)  has  also  discussed  the 
measurement  of  kinetic  parameters  utilizing  fluctuations.  The 
basis  of  this  method  of  determining  kinetic  parameters  can  be 
understood  in  terms  of  the  random  pertur-bations  discussed  in  the 
previous  section  on  system  characterization. 

As  chemists,  we  should  recognize  that,  on  a molecular  or 
atomic  basis,  all  species  are  being  continuously  perturbed  sto- 
chastically. Collisions  among  chemical  species,  random  dissoci- 
ation reactions,  and  other  occurances  all  act  as  perturbations. 

The  reaction  of  the  chemical  system  to  these  perturbations  can 
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however,  not  bo  random  but  must  follow  flu*  physical  and  chemical 
kinetic  laws  govern inq  those  particulai  species.  Thus  the 
measurement  of  a particular  response  (unci  ion  of  the  ohomio.il 
system  should  be  able*  to  be  achieved  without  the  explicit  random 
input  depicted  for  the  black  box  in  the  last  section.  The  inj u* 
would  be  the  naturally  occurring  random  perturbut ions  within  and 
around  the  chemical  system  under  study.  Observat  .ion  of  some 
property  of  one  or  more  of  the  species  in  the  system  should  then 
provide  information  about  the  temporal  behavior  of  that  spcci<  . 
Thus  in  the  laser  scattering  experiments,  the  intensity  fluctua- 
tions in  the  scattered  laser  light  reflect  concentration  fluctua- 
tions due  to  diffusion  of  macromolecules. 

In  the  more  recent  work  of  Feher  and  Weissmnn  (1971)  and 
Elson  and  Magdo  (1974)  concentration  fluctuations  are  reflected 
in  conductivity  and  fluorescence  intensity  fluctuations  from 
which,  by  autocorrelation,  chemical  kinetic  information  can  bo 
obtained.  To  understand  these  experiments,  consider  the  simple 
reaction  shown  below: 

a + n + c 

We  would  ordinarily  think  of  this  chemical  reaction  ns  beinu 
nt  equilibrium.  Of  course,  any  true  chemical  "equilibrium" 
is  really  a dynamic  system,  involving  b h forward  (k^)  and 
(k_^)  reverse  reactions.  Therefore,  the  concentrations  of  all 
reactants  and  products  in  the  reaction  are  continuously  changing 
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because  of  natural,  stochastic  perturbation  around  and  within 
them.  However,  as  in  the  preceding  examples,  the  chemical 
species  cannot  react  instantaneously  to  these  perturbations 
but  must  change  in  concentration  in  accordance  with  their  own 
kinetic  character! sties . Thus,  if  the  concentration  of  species 
C was  observed  over  a period  of  time,  its  kinetic  behavior 
could  be  deduced  by  autocorrelation  analysis  of  its  concentra- 
tion fluctuations. 

Although  this  method  of  measuring  chemical  kinetics  has 
not  been  broadly  explored  and  is  not  yet  widely  recognized,  it 
is  certain  to  be  of  great  significance  in  the  future.  it  en- 
ables reaction  kinetics  to  be  observed  under  essentially  equi- 
librium conditions,  thereby  simplifying  mechanistic  interpret- 
ation of  the  kinetic  information.  In  addition,  it  is  unneces- 
sary to  externally  perturb  the  system.  Extremely  rapid 
kinetics  can  be  observed  , in  fact,  the  speed  with  which  kinetics 
can  be  observed  is  limited  only  by  the  response  time  of  the 
devices  being  used  to  monitor  the  chosen  species.  These  and 
other  potential  advantages  are  discussed  further  in  the  references 
cited  in  this  section.  Certainly  one  "advantage",  mentioned  by 
Feher  and  Weissman  is  "the  personal  satisfaction  of  using  rather 
than  fighting  noise".  Clearly  noise  correlation  represents  a 
new,  powerful  and  elegant  technique.  It  rovides  both  unique 
measurement  capabilities  for  chemical  parameters  and  fresh  in- 
sight into  chemical  systems. 
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Finally  a related  area,  that  of  calculating  molecular 
motion  information  by  Fourier  transforming  infrared  and  Raman 
spectral  band  shapes  should  be  mentioned.  The  rose  it  is  a so- 
called  time  correlation  function  that  can  provide  information 
about  molecular  rotation  (Gordon,  1965;  Shimizu,  1965).  In  a 
sense,  the  laser  scattering  experiments  are  just  line  broaden  nv 
measurements.  However,  the  spectral  resolution  necessary  for 
its  observation  is  beyond  the  capability  of  essentially  all 
conventional  techniques  except  perhaps  the  Fabry-Perot  inter- 
ferometer and  thus  new  approaches  such  as  the  intensity  cor- 
relation method  were  developed.  In  the  infrared,  however,  the 
broadening  of  the  spectral  lines  by  molecular  rotation  can  be 
measured  directly  by  conventional  spectroscopic  techniques  and 
the  peak  shape  transformed  by  software  to  give  the  autocorrel- 
ation function.  However,  more  recently,  Rayleigh  light  scat- 
tering techniques  have  been  used  to  measure  orientational  cor- 
relation functions  in  liquids  as  very  short  time  behavior  can 
be  observed  (Dill  et  al,1975). 

E . CORRELATION  SPECTROSCOPY  AND  INTERFEROMETRY . 

Correlation  spectroscopy  is  basically  a hardware  method 
of  cross-correlating  a measured  spectrum  with  a stored  replica 
of  the  sought  for  spectrum  (Williams  and  )litz,  1968;  Davies, 
1970)  . Typically  a mask  replica  of  the  sought  for  spectrum  is 
positioned  in  the  exit  focal  plane  of  a spectrometer  and  either 
the  mask  or  the  spectrum  is  oscillated  to  generate  a chopped 
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signal  whose  amplitude  is  a maximum  when  the  specti um  most 
closely  matches  the  exit  mask.  Note  that  this  is  essential ]y 
identical  to  the  software  cross-correlation  operation  depicted 
in  Section  II,  E for  the  Co,  Ni  and  Fe  spectra  except  that 
only  the  value  of  the  cross-correlation  function  at  t = 0 is 
being  evaluated  with  this  mask  technique.  One  of  the  main 
application  areas  for  this  technique  has  been  the  detection  of 
gaseous  air  pollutants  and  recent  studies  utilizing  this  tech- 
nique have  been  presented  by  Strojek  et  al,  (1975)  and  by- 
Walter  and  Flanigan  (1975)  . 

Similar  correlation  techniques  have  also  been  used  to 
process  interferograms  obtained  from  a Michelson  interferometer 
as  used  in  Fourier  transform  spectroscopy  (Davies,  1970;  Dick 
and  Levy,  1970).  With  this  technique  quantitative  information 
can  be  obtained  from  an  interferogram  without  the  necessity  of 
Fourier  transformation.  This  method  has  excellent  potential 
for  providing  simple  systems  to  process  interferograms. 

F . CORRELATION  CHROMATOGRAPHY 

In  normal  chromatographic  operations,  there  can  be  an 
appreciable  delay  between  the  injection  of  a sample  and  readout 
of  the  peak  information.  Correlation  techniques  have  been  in- 
vestigated with  the  idea  of  achieving  c tinuous  chromatographic 
analysis  (Annino  and  Bullock,  1973).  As  mentioned  in  Section 
III,  C a system  can  be  characterized  by  measuring  its  impulse 
response  function.  The  injection  of  a sample  into  a chromato- 
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graph  can  bo  considered  as  an  impulsive  input  , thus  a normal 
chromatogram  is  the  impulse  response  fund  ion  of  t hi*  chromato- 
graph. It  was  seen  in  Section  111,  C that  the  same  information 
could  be  measured  utilizing  a random  input  function  and  ctoss- 
correlatinq  the  system  output  with  the  random  input.  This  is 
the  basis  of  correlation  chroma toqraphy . 

To  produce  a correlation  chromatograph,  a random  or 
pseudo  random  command  siqnal  is  vised  to  control  the  sample 
valve  to  switch  it  back  and  forth  between  the  sample  stream 
and  carrier  gas  or  standard  sample.  When  the  output  siqnal  of 
the  chromatograph  is  cross-correlated  with  the  pseudo  random 
input  control  siqnal,  the  result  is  a correlation  function  that 
has  the  appearance  of  a normal  single  injection  chromatogram . 

Although  quite  similar  to  a normal  single  impulse  chromate 
gram,  the  correlogram  differs  in  the  following  respects.  Since 
it  contains  the  averaqe  information  obtained  from  a number  of 
injections,  it  provides  a more  reliable  estimate  of  the  siqnal. 
Also,  as  new  information  appears  in  the  output,  the  oldest  is 
rejected  and  a new  updated  correlogram  is  calculated  and  dis- 
played. This  implies  the  possibility  of  creating  a chromato- 
graphic system  .in  which  the  sample  value  rapidly  and  repeatedly 
injects  samples  and  which  displays  a chrnmntoqram  following  sam- 
ple concentration  variations  more  or  less  continuously . Finally 
the  correlogram  has  an  increased  signal-to-noiso  ratio  compared 
to  a single  impulse  chromatogram  due  to  the  fact  that  random 
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noise  does  not  corrclote  and  therefore  i r»  automat r ea 1 1 y cancc  \ t <•  d 
in  the  operation.  Although  some  of  these  ideas  have  boon  von 
fied  experimentally,  correlation  chromatography  uulfois  ccrta'u 
limitations  because  of  nonlinearities  in  the  chromatographic  sys 
tern.  The  practical  aspects  and  limitations  of  correlation 
chromatography  are  discussed  in  detail  by  Annino  and  Bullock  M"  ’ D . 

G.  A CORRELATION  METHOD  FOR  THE  MEASUREMENT  OF  DECAYING 
EXPONENTIALS . 

In  a recent  paper  by  Miller  et  al,  (1975)  a cross- 
correlation method  for  tiro  measurement  of  decaying  exponentials 
is  presented.  The  measurement  system  was  actually  applied  to  semi- 
conductor transient  signals  but  it  should  be  applicable  to  any  situ- 
ation where  similar  signals  are  measured.  This  is  an  excellent 
paper  to  road  in  order  to  get  a feel  for  the  correlation  ap- 
proach to  measurement. 

The  b.asic  idea  of  this  correlation  measurement  system  is 
shown  in  Figure  35.  Clearly,  this  is  just 

a hardware  implementation  of  matched  filtering  (Section  TI , B) 
where  the  noisy  exponential  is  cross-correlated  with  a noise 
f ee  exponential.  The  performance  of  the  correlator  is  dis- 
cussed and  compared  with  boxcar  integration  and  lock-in  ampli- 
fication for  the  same  measurement.  In  dition,  the  utility 
of  alternative  weighing  functions  to  the  exponential  is  assessed. 
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From  I ho  foregoing  sort  ions,  it  is  clour  th.it  or  ro  1 .1 1 1 < >1 
techniques  can  bo  effectively  applied  to  a wide  range'  of  olu-mu 
measurement  and  signal  processing  situations.  However,  one  oi 
the  most  serious  drawbacks  to  the  wide  spread  utilization  of 
correlation  techniques  has  been  the  unavailability  of  suitable 
computational  methods  or  instrumentation  for  carrying  out  the 
correlation  operation.  In  the  last  few  years,  significant  pro- 
gress has  been  made  in  both  software  and  hardware  approaches  fig 
the  implementation  of  correlation.  In  addition,  present  de- 
velopments in  certain  large  scale  integrated  circuits  such  as 
diode  arrays  and  CCD’s  should  provide,  in  the  near  future,  very 
inexpensive  devices  capable  of  sophisticated  correlation  opera- 
tions. The  areas  to  which  correlation  techniques 
are  now  being  applied  have  been  greatly  expanded  by 
these  instrumental  developments. 

A . SOFTWARE  APPROACHES 

With  the  wide  spread  use  of  small  computers  in  the 
chemical  laboratory  correlation  techniques  can  easily  be  im- 
plemented on  a variety  of  signals  using  software.  Data  can  be 
read  into  the  computer  in  a variety  of  ways,  but  for  most  flex- 
ibility in  a laboratory  environment,  the  -asic  computer  system 
should  include  an  analog-to-digital  converter  for  acquisition 
of  signals  and  standard  analog  outputs  such  as  a plotter  and  a 
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scope  or  graphics  unit  no  that  the  correlation  function  >nd  sig- 
nals can  be  conveniently  displayed. 

A minicomputer  system  that  has  been  used  for  a variety 
of  correlation  applications  in  one  of  the  authors  laboratories 
is  shown  in  Figure  36.  The  analog  input  consists  of  a sample 
and  hold  amplifier  with  a 50  nsec  aperture  time  (Analogic  MP- 
250)  coupled  to  a 10  bit  ADC  with  a conversion  time  of  10  usee 
(Analogic  M 2810)  . Data  acquisition  is  initiated  by  a start 
pulse  indicative  of  the  beginning  of  the  signal  and  is  clockc'1 
in  at  a rate  appropriate  to  accurate  sampling  of  the  specific 
signal  (Kelly  and  Horlick,  1973).  Data  can  be  displayed  on  an 
oscilloscope  or  a strip  chart  recorder  via  a DAC , listed  on  the 
DEC  writer  terminal  or  permanently  stored  on  magnetic  tape  (DRC 
tape)  for  further  processing.  The  computer  is  a DF.C  PPP9/e  with 
16K  of  core  and  a DEC  tape-based  OS/8  operating  system.  The 
software  was  written  primarily  in  FORTRAN.  Machine  language 
(SABR)  was  used  to  input  data  from  the  ADC  and  output  data  to 
the  DAC  via  a DEC  DR8-EA  12-channel  buffered  digital  T/O.  The 
machine  language  commands  could  be  inserted  directly  in  the 
FORTRAN  program,  a feature  that  has  proven  to  be  exceptionally 
convenient  and  powerful  in  our  laboratories,  obviously,  a numbe 
of  other  systems  could  be  used,  but  that,  shown  in  Fiqure  3f  is 
typical  of  the  capability  required  in  a flexible  system  for 
laboratory  oriented  correlation  applications  utilizing  a mini- 
computer. 


The  basic  equation  »>1 
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a discrete  eerie’ at  ion  operation 
(Equation  2)  is  easy  to  ptogtam  and  simple  programs  im  the 
direct  implementat  ion  ot  cot  rolot  ion  filtei  inn  operat  iritis  wrir 
presented  by  Savitzky  ami  Go lay  (1964).  However,  for 
moderately  large  arrays  correlation  can  be  quite  time  consumine 
on  computers.  The  Founoi  transform  route  of  correlation  is 
often  a much  quicker  computational  route.  In  particular,  the 
Fast  Fourier  Transform  algorithm  has  essentially  revolutionized 
the  extent  to  which  correlation  techniques  are  utilized  for 
processing  scientific  signals.  The  Fourier  transform  route  ot 
correlation  was  discussed  in  Section  I and  emphasized  through- 
out Section  II. 

Finally,  it  should  be  mentioned  that  many  manufacturers 
are  now  providing  complete  software  based  systems  that,  are 
applicable  to  correlation  analysis.  Among  these  are  the  DEC LAB- 
11/10  systems  and  the  TEKTRONIX  digital  processing  oscillo- 
scope (Ramirez,  1975)  . These  systems  can  he  obtained  with  the 
ADC,  DAC  and  graphics  hardware  necessary  for  a very  powerful 
correlation  signal  processing  system.  In  addition,  complete 
software  packages  are  available  such  as  DEC'S  Lab  Applications 
11  (Dulaney,  1975)  that,  contains  FFT  capability.  These  and 
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similar  systems  can  provide  the  experimenter  with  very  flexible 
and  powerful  correlation  signal  processing  capability. 
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B . HARDWARE^  CORRELATO RS 

At  the  present  time,  it  is  really  in  the  hardware  area 
that  some  of  the  most  exciting  advances  are  occurring  in  the 
development  of  systems  that  are  capable  of  evaluating  correla- 
tion functions.  Despite  the  relatively  high  cost  of  most  com- 
mercial hardware  correlators  a number  of  electronic  components 
and  subsystems  are  now  available  which  allow  the  design  and 
construction  of  sophisticated  but  inexpensive  correlation  in- 
strumentation . 

There  are,  of  course,  many  approaches  that  can  be  taken 
in  the  design  of  a hardware  correlator.  One  of  the  simplest  basic 
designs  is  that  shown  in  Figure  37a.  This  correlator  consists  of  a 
four  quadrant  multiplier  and  a low  pass  filter.  A four  quadrant 
raultiplier  is  simply  an  analog  multiplier  capable  of  multiplying 
two  analog  sianals  of  any  polarity.  Units  such  as  Analog  Devices 
Mode]  426A  has  better  than  1%  accuracy  and  sells  for  less  than 
$50.  Units  with  better  than  4%  accuracy  can  be  purchased  for 
about  $10.  Thus  the  correlator  illustrated  in  Figure  37a  is 
indeed  inexpensive. 

A remarkably  large  number  of  correlation  measurements 
can  be  carried  out  with  this  simple  instrument.  As  illustrated 
in  Figure  10,  this  correlator  forms  the  basis  of  the  lock-in 
amplifier.  With  relatively  simple  additional  circuitry  (Horlick 
and  Betty,  1975:  Malmstadt  et  al  , 1*>74)  inexpensive  lock-in 
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amplifiers  can  easily  be  constructed  from  this  basic  unit.  In 
addition,  the  correlation  discussed  in  Section  III,  A and  the 
demodulation  correlation  measurement  (Hieftie  et  al , 1973a)  men- 
tioned in  Section  III,  B can  both  be  carried  out  with  this  sim- 
ple correlator. 

The  versatility  and  applicability  of  this  correlator 
can  be  greatly  extended  by  the  addition  of  a function  generator 
as  shown  in  Figure  37b.  This  correlator  is  primarily  applic- 
able to  repetitive  signals.  A simple  function  generator  is 
shown  in  Figure  38a  along  with  the  appropriate  waveforms.  It 
consists  of  a variable  delay  monostable  and  a gate  monostable, 
where  the  gate  function  is  the  waveform  sent  to  the  multiplier. 
With  this  function  generator,  our  correlator  becomes  the  familiar 
boxcar  integrator  (Malmstadt  et  al , 1974;  Hieftje,  1972a; 

Hieftje,  1972b)  and  in  this  application  the  four  quadrant  mul- 
tiplier can  even  be  replaced  by  an  analog  FET  gate. 

A simple  modification  of  this  function  generator 
is  shown  in  Figure  38b  in  which  an  OA  differentiator  (high 
pass  filter)  and  a clipping  circuit  are  connected  to  the  out- 
put of  the  gate  monostable.  Now  the  function  generator  is 
capable  of  generating  a variety  of  decaying  exponentials 
and  matched  filter  correlation  measuremen  can  be  carried 
out  such  as  that  discussed  in  Section  III,  G (See  Figure 
35).  Obviously,  this  approach  is  applicable  to  a wide  variety 
of  measurements,  limited  only  the  experimenters  ability  and 


ingenuity  in  designing  appropriate  function  generators. 

The  correlators  illustrated  in  Figure  37  are  limited  in 
that  essentially  only  the  value  of  the  correlation  at  t * 0 if 
evaluated,  although  some  variation  in  t is  possible  with  the 
function  generators  shown  in  Figure  38  by  adjusting  the  delay 
monostable  However,  for  more  general  purpose  correlation 
operations,  an  instrument  such  as  that  shown  in  Figure  3^a  is 
necessary  (Malmstadt  et  al,  1974). 

This  correlator  is  capable  of  correlating  a reference 
waveform  stored  in  a digital  memory  with  a repetitive  analog 
waveform  with  the  resulting  correlation  function  being  plotted 
on  a recorder.  The  correlator  consists  of  two  basic  sections, 
a digital  storage  and  shifting  section  for  the  reference  wave- 
form and  the  analog  correlation  unit  previously  described.  The 
desired  reference  waveform  is  first  read  into  the  N-word  cir- 
culating shift  register  memory  via  the  analoa-to-digital  con- 
vertor. One  point  of  the  correlation  function  between  this 
reference  waveform  and  a repetitive  analog  signal  can  then  be 
evaluated  by  triggering  the  circulation  of  the  memory  with  a 
pulse  indicative  of  the  start  of  the  signal  repetition.  After 
sufficient  products  have  been  integrated  to  reach  a steady  state 
value  at  the  output  of  the  low  pass  filter,  the  sequencer  sends 
a single  extra  clock  pulse  to  the  shift  register  which  shifts 
the  position  of  the  reference  waveform,  relative  to  the  start 
pulse,  one  clock  period.  The  value  of  the  correlation  function 
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at  this  new  relative  position  is  then  evaluated  by  repetitive 
multiplication  and  integration  and  then  the  shift  pulse  is  again 
applied.  In  this  manner,  the  complete  correlation  function  can 
slowly  be  evaluated  and  plotted  on  a recorder. 

Even  though  this  correlator  is  considerably  more  sophis- 
ticated than  those  shown  in  Figure  37,  it  is  not  particularly 
difficult  or  expensive  to  build.  For  example,  typical  medium 
speed  10  bit  DAC's  and  ADC's  can  be  obtained  for  $50  and  $100. 

In  the  past,  a major  stumbling  block  in  building  such  a cor- 
relator would  have  been  the  memory.  However,  a wide  variety  of 
inexpensive  shift  register  memories  are  now  available  and  the 
construction  of  an  N-word  circulating  shift  register  memory  is 
relatively  simple  using  these  IC's.  For  example,  1024  by  one 
bit  shift  registers  can  be  obtained  in  a single  8 pin  IC  package 
(Signetics  2533)  for  less  than  $15.  Ten  of  these,  appropriately 
interconnected,  provides  a 1024  word  10  bit  shift  register 
memory.  Other  memories  of  shorter  lengths  are  available  that 
combine  more  then  one  register  on  each  IC  such  as  dual  - 256 
bit  (Signetics  2527)  and  hex  - 32  bit  (Signetics  2518)  shift 
register  memories.  Also  the  combination  of  the  ADC,  shift  reg- 
ister memory,  and  DAC  constitute  what  is  known  as  a transient 
recorder  (Malmstadt  et  al , 1974).  These  Instruments  are  avail- 
able commercially  (Biomation,  10411  Bubb  Road,  Cupertino, 
California  95014)  or  can  be  built  following  designs  such  as 
that  of  Korte  and  Denton  (1973)  and  Daum  and  Zamie  (1974). 
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Many  variations  and  extensions  of  the  basic  design  shown 


in  Figure  39a  are  possible.  If  it  is  only  necessary  to  cross- 
correlate the  signal  with  a binary  pattern  this  correlator  can 
be  simplified  to  that  shown  in  Figure  39b  where  the  N-word  memory 
is  replaced  with  an  N-bit  circulating  shift,  register  memory. 

Now  a single  3 pin  IC  can  store  up  to  a 1024  bit  binary  pattern. 
Such  a unit  can  be  useful  for  pattern  detection  (Codding  and 
Horlick,  1973b)  or  can  be  used  as  a versatile  scanning  boxcar 
integrator  (Malmstadt  et  al,  1974).  If  the  signal  is  not  repeti- 
tive or  if  autocorrelations  are  to  be  evaluated,  then  a second 
memory  section  must  be  added  as  shown  in  Figure  40.  Also  if 
desired,  the  Correlation  function  evaluation  could  be  carried 
out  digitally  rather  than  using  the  analog  approach  presented 
in  these  examples.  At  this  point,  one  reaches  the  rather  com- 
plex and  expensive  (but  powerful)  completely  digital  hardware 
correlators  available  from  such  sources  as  Hewlett-Packard 
(Hewlett-Packard,  1969) , Saicor  (Honeywell  Signal  Analysis 
Operation,  Test  Instruments  Division,  595  Old  Willets  Path, 
Hauppauge,  New  York  11787) , Spectral  Dynamics  Corporation, 

P.O.  Box  671,  San  Diego,  CA  92112,  and  Elsytic,  232  Michael 
Drive,  Syosset,  New  York  11791.  However,  it  should  be  clear 
from  this  discussion,  that  correlation  instrumentation  need  not 
be  looked  upon  as  complex  and  expensive.  The  simple  correlators 
depicted  here  are  quite  capable  of  carrying  out  a wide  variety 
of  sophisticated  and  useful  correlation  operations. 
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1 • Correlators  for  Fluctuation  Spectroscopy 

Although  convention  autocorrelation  instrumentation  is 
applicable  to  fluctuation  spectroscopy  measurements,  many 
workers  have  constructed  their  own  correlators,  particularly 
autocorrelators  capable  of  processing  a PM  tube  signal  measured 
in  a photon  counting  mode.  The  correlators  are  often  referred 
to  as  digital  correlators  or  photon  correlators.  Some  are 
solely  hardware  based  and  others  combine  external  hardware  and 
conventional  minicomputers. 

The  general  nature  of  the  photon  autocorrelation  measure- 
ment has  been  discussed  by  Pusey  et  al.  (1974).  A 1024-channel 
digital  correlator  was  presented  by  Abies  et  al.  (1975),  and 
fast  digital  correlator  for  weak  optical  signals  by  Corti  (1974). 
Digital  correlators  using  minicomputers  have  been  developed  by 
Wijnaendts  van  Resandt  (1974)  and  by  Gray  et  al,  (1975).  Also, 
a number  of  simple  schemes  for  measuring  autocorrelation  func- 
tions of  fluctualing  signals  are  presented  by  Kam  et  al,  (1975)  . 
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C.  PIOPE  ARRAY  CORRELATION  INSTRUMENTATION 

Integrated  circuits  based  on  diode  arrays  and  charge 
coupled  devices  (CCD's)  show  promise  of  providing  remarkably 
sophisticated  correlation  instrumentation  and  operations  in 
very  compact  packages.  These  devices  have  initially  been  devel- 
oped for  electronic  imaging  applications  (Talmi,  ]‘>75).  in 
this  form  a photodiode  array  has  facilitated  the  development  ot 
an  analog  cross-correlation  readout  system  for  spectrochemical 
applications.  More  recently,  diode  arrays  have  also  been  fabri- 
cated as  analog  shift  registers  and  tapped  analog  delay  lines. 

The  unique  applicability  of  these  devices  to  correlation  measure- 
ments will  be  discussed  in  this  section. 

1.  A Photodiode  Array  Based  Correlator  for  Spectrochemical 
Applications . 

A photograph  of  a 512  element  self-scanning  linear  silicon 
photodiode  array  is  shown  in  Figure  41.  The  thin  line  across 
the  center  is  the  actual  array  of  diodes.  They  are  0.001"  high 
and  the  elements  are  on  0.001"  spacing;  thus  this  array  is  0.512" 
long.  The  array,  complete  with  scanninq  circuitry  is  packaged 
in  an  18  pin  dual-in-line  IC  package.  A simplified  schematic 
of  the  complete  integrated  circuit  is  shown  in  Figure  42.  Each 
photodiode  is  connected  to  the  output  line  by  a FFT  switch.  The 
FET  switches  are  controlled  by  a single  bit  that  is  shifted 
through  the  shift  register.  Readout  is  accomplished  using  two 
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TTL  level  signals,  a start  pulse  and  a clock.  Although  the 
actual  circuitry  is  somewhat  more  complex  than  that  shown  in 
Figure  42,  the  start  pulse  can  be  thought  of  as  setting  the 
first  bit  of  the  shift  register  and  the  clock  then  cycles  the 
bit  through  the  sh  Tt  register  reading  out  the  array. 

The  photodiodes  operate  in  the  charge  storage  mode  and 
hence  are  inherently  integrating  type  detectors.  When  a par- 
ticular FET  switch  is  closed  by  the  bit  in  the  shift  register, 
the  diode  is  charged  up  to  its  full  reverse  bias  potential. 

This  reverse  bias  charge,  stored  on  the  equivalent  capacitance 
of  the  PN  junction,  can  then  be  discharged  between  scans  by  pho- 
ton generated  charge  carriers  (light  falling  on  the  diode)  and 
by  thermally  generated  charge  carriers  (dark  current) . Thus  the 
signal  level  necessary  on  the  subsequent  scan  to  re-establish 
reverse  bias  on  the  diode  is  a measure  of  the  total  light  in- 
tensity and  dark  current  integrated  over  the  time  between  scans 
of  the  array.  Thus  this  device  can  be  considered  as  a 512  ele- 
ment. analog  shift  register  with  parallel  optical  inputs  and  a 
serial  electrical  output. 

A unique  cross-correlation  readout  system  for  spectro- 
chemical  meausrements  has  been  developed  utilizing  this  sensor 
as  the  detector  (Horlick  and  Codding,  1973).  A block  diagram 
of  the  cross-correlation  readout  system  is  shown  in  Figure  43a. 
The  photodiode  array  was  mounted  in  the  focal  plane  of  the  mono- 
chromator. A 256  element  array  was  used  for  this  application 


68 


ant!  c.i.-w.,t  110  A of  spectral  information  could  be  simultaneously 
observed.  A typical  output  signal  for  a triplet  spectrum  is 
shown  .chematical ly  in  Figure  43b  as  it  would  appear  on  an  os- 
cilloscope at  point  X in  Figure  43a.  The  array  was  clocked  at 
a rate  of  30  kHz  so  a complete  spectrum  (110  A region)  was  read 
out  j>  <5.5  msec.  The  repetition  time  (time  between  start  pulses) 
was  60  msec  (17  spectra/sec) . 

The  nature  of  the  correlator  is  the  same  as  that  shown 
in  Fir;i>>:e  37b.  The  function  generator  for  this  application  is 
shown  ; n Figure  44.  It  consists  of  three  delay  monostable  (DM)- 
gate  ri.onos table  (GM)  combinations  and  a system  of  operational 
amplifiers.  Using  this  function  generator,  any  of  the  output 
wavefoims  can  be  generated  in  synchronism  with  the  spectral  trace 
from  i^e  photodiode  array.  The  simple  pulse  waveform  is  shown 
in  Figure  43b  as  it  would  appear  on  an  oscilloscope  at  point 
Y in  rigure  43a. 

Cn  order  to  vary  x and  hence  cross-correlate  a spectral 
regie.  ith  a particular  pulse  waveform,  the  monochromator  was 
scanned  slowly  (0.2  A sec).  This  results  in  the  spectrum  being 
slowly  scanned  past  the  electronic  gate.  This  is  exactly  anal- 
ogous to  scanning  a dispersed  spectrum  past  a mechanical  exit 
slit  (see  Figure  5) . Thus  the  pulse  gate  amounts  to  an  "elec- 
tronic exit  slit".  In  contrast  to  the  mechanical  slit,  the 
electronic  slit  can  take  on  several  unique  forms  (Figure  44a) . 
Usefu)  modifications  of  the  spectral  information  can  be  carried 
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out  by  cross-correlation  with  certain  types  of  bipolar  pulBes. 

Two  examples  are  shown  in  Figure  45.  The  sequence  shown  in 
Figure  45a  illustrates  a cross-correlation  that  results  in  resol- 
ution enhancement  and  that  in  Figure  45b  in  an  approximate  first 
derivative.  The  bipolar  pulse  shown  in  Figure  45a  is  a square 
approximation  to  a second  derivative  response  function  and  that 
in  Figure  45b  to  a first  derivative  response  function.  Thus 
these  direct  cross-correlations  are  analogous  to  the  Fourier 
domain  filtering  discussed  in  Section  II,  C. 

Thus  this  analog  cross-correlation  system  provides  a 
unique  and  versatile  approach  to  spectrometric  readout.  A wide 
range  of  powerful  spectral  signal  processing  operations  in 
addition  to  those  illustrated  here,  can  also  be  effectively  im- 
plemented with  this  system.  For  example,  mask  correlation 
spectroscopy  discussed  in  Section  III,  E could  be  flexibly  im- 
plemented with  this  system  as  the  mask  could  be  replaced  by  a 
characteristic  electronic  gating  waveform. 

2.  Diode  Array  Analog  Shift  Registers. 


As  mentioned  in  the  last  section,  the  photodiode  array 
is  really  an  analog  shift  register  with  parallel  optical  inputs 
and  a serial  electrical  output.  Diode  array  devices  are  now 
available  that  are  complete  analog  shift  :gisters  (delay  lines) 
with  serial  electrical  input  and  output.  A simplifed  schematic 
of  a SAM- 128V  Serial  Analog  Memory  (128  diodes)  available  from 
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Reticon  Corp.,  910  Benicia  Ave.,  Sunnyvale,  California  94086 
is  shown  in  Figure  46.  The  diodes  are  shown  only  as  their 
equivalent  capacitors.  The  read-in  shift  register  controls 
the  sequential  sampling  of  the  analog  input  signal  and  the  read- 
out shift  register  controls  the  sequential  interrogration  of 
the  diode  (capacitor)  memory  elements.  The  read -in  and  read- 
out rates  are  independent,  thus  the  analog  signal  can  be  recon- 
structed with  a different  time  base.  Also,  each  memory  capacitor 
has  a FET  buffer  stage,  thus  read-out  (unlike  that  with  the 
photodiode  array)  is  non-destructive.  However,  with  present 
devices  the  retention  time  without  significant  degradation (because 
of  "dark"  current)  is  40  msec  at  room  temperature. 

Clearly  this  type  of  device  is  potentially  an  extremely 
powerful  circuit  element  for  incorporation  into  correlation 
instrumentation.  This  single  I C,  with  appropriate  clocking 
circuitry  can  function  as  a complete  transient  recorder.  Thus, 
some  of  t^ie  correlation  instrumentation  shown  in  Section  IV,  B 
could  be  considerably  simplified  utilizing  this  device.  In 
addition,  this  particular  serial  analog  memory  possesses  some 
features  which  make  it  uniquely  applicable  to  binary  sequence 
correlation.  Readout,  as  mentioned  above,  is  controlled  by  the 
readout  shift  register.  If  a bit  exists  in  the  nth  stage,  the 
nth  cell  will  be  read  out.  Thus  if  a specific  binary  sequence 
is  clocked  into  the  readout  shift  register,  the  output  will  be 
the  summation  of  the  products  of  the  binary  sequence  and  the  stored 
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analog  information.  This  application  amount j to  the  rapid  cross- 
correlation of  a stored  analog  signal  with  e moving  binary  se- 
quence. Thus  a number  of  powerful  signal  detection  correlations 
can  be  carried  out  with  what  amounts  to  a s(ng]e  18  pin  integ- 
rated circuit  as  the  correlator. 

3.  Tapped  Analog  Delay  Line 

A variation  of  the  analog  shift  register  known  as  a tapped 
analog  delay  line  is  capable  of  implementing  a number  of  unique 
correlation  operations  on  analog  signals,  particulary  matched 
filtering.  A schematic  of  a tapped  analog  delay  line  is  shown 
in  Figure  47.  Basically  the  device  consists  of  an  analog  shift 
register  (delay  line)  with  output  taps  on  each  storage  element. 
Many  applications  can  be  implemented  with  a small  number  of  de- 
lay elements  and  the  unit  shown  in  Figure  47  has  only  9 delay 
elements  and  taps.  The  output  of  the  tapped  analog  delay  line 
is  simply  the  weighed  sum  (as  set  by  the  resistor  values)  of  9 
sequential  signal  values.  Thus  an  analog  signal  can  be  cross- 
correlated  (filtered)  by  an  desired  9 point  correlation  filter 
simply  by  choosing  appropirate  resistor  values.  In  addition, 
not  all  taps  need  be  connected  to  a single  output  amplifier, 
thus  an  incredibly  wide  range  of  filtering  operations  are  pos- 
sible with  such  a device. 

As  a simple  example,  a conventional  low  pass  filter  can 
be  simulated  by  giving  tap  1 the  most  weight  ard  the  following 
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taps  exponentially  decreasing  weight.  It  is  well  known  that 
such  a filter  can  distort  a peak  signal  because  only  the  present 
and  past  values  contribute  to  the  output  value  (Savitzky  and 
Golay,  1964).  In  the  past  this  was  essentially  impossible  to 
avoid  by  real  time  analog  techniques  and  could  only  be  avoided 
by  using  digital  data  processing.  However,  with  the  tapped 
analog  delay  line  filter  a trivial  modification  achieves  the 
desired  result.  It  is  simply  necessary  to  give  tap  5 the  most 
weight  and  then  give  the  taps  on  either  side  exponentially  de- 
creasing weight.  In  this  manner,  symmetrical  doubled  sided 
exponential  filtering  can  be  implemented.  Clearly,  such  devices 
are  destined  to  be  widely  employed  in  scientific  instrumentation 
as  real  time  analog  correlators.  A serial  analog  delay  line, 
based  on  diode  arrays,  with  24  storage  cells  and  12  equally 
spaced  taps  is  presently  available  from  Reticon  (TAD-12) . 
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An  analog  data  processor  for  chart  records,  whose  capa- 
bility is  analogous  to  that  of  a tapped  analog  delay  line,  has 
been  constructed  by  Minami  et  al,  (1969).  This  processor  was 
based  on  an  array  of  ten  independent  diodes,  a detector  which 
is  used  in  conventional  punched  tape  readers.  It  was  capable 
of  evaluating  the  cross-correlation  between  a number  of  10 
point  correlation  functions  (exponential,  boxcar  (moving  average), 
and  Savitzky-Golay  type  filtering  functions)  and  any  type  of 
data  in  the  form  of  recorder  traces. 

D.  CHARGE  COUPLED  DEVICE  CORRELATION  INSTRUMENTATION 

Charge  coupled  devices  (CCD's)  are  relatively  new  elec- 
tronic devices  that  are  applicable  to  both  electronic  imaging 
and  analog  shift  register  applications.  A schematic  of  CCD 
operation  is  shown  in  Figure  48.  Basically,  the  CCD  concept 
involves  manipulation  of  charge  on  the  surface  of  a semicon- 
ductor by  moving  a potential  minimum  (Boyle  and  Smith,  1970) . 

In  the  structure  shown  in  Figure  48,  every  third  electrode  is 
connected  to  a common  conductor.  Initially  (Figure  48a)  voltage 
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^2  greater  than  V^.  This  generates  a depletion  region  under 
electrodes  1,  4,  7....  and  any  positive  charge  present  or  gen- 
erated near  one  of  these  electrodes  (such  as  1 and  7)  will  col- 
lect near  it.  If  a .voltage  V3  (V3  > V2)  is  applied  to  electrodes 
2,  5,  8.... (Figure  48b)  the  charge  will  be  transferred  from  one 
electrode  to  the  next.  In  the  final  sequence  (Figure  48c)  the 
voltage  is  now  applied  to  electrodes  2,  5 and  8.  Thus  the 
CCD  is  really  an  elegantly  simple  analog  shift  register. 

As  with  diode  arrays,  most  of  the  initial  applications 
of  CCD's  have  been  in  electronic  imaging  (Talmi,  1975),  although 
they  are  now  being  applied  to  both  analog  and  digital  shift 
register  applications.  A 100  element  linear  CCD  device  is  avail- 
able (GEC  Semiconductors,  East  Lane  Wembley,  Middlesex,  England 
HA9  7PP)  that  is  an  imaging  device  and  hence  has  100  parallel 
optical  inputs  and  also  has  a serial  analog  input  so  it  can  be 
used  as  an  analog  shift  register  and  a line  imager  either 
separately  or  simultaneously.  In  addition,  tapped  CCD's  are 
being  developed  for  various  analog  signal  processing  applications 
(Tiemann  et  al , 1974;  Beny  and  Husson  1975). 

The  basic  implementation  of  CCD  based  correlation  operations 
is  analogous  to  that  with  diode  arrays.  CCD's  are  somewhat  sim- 
pler to  fabricate  and  perhaps  will  become  the  device  of  choice  in 
the  future.  Also,  interest  remains  high  j.  i the  development  of 
addition  solid  state  devices  with  correlation  signal  processing 
capability.  Recently,  considerable  research  has  been  carried  out 
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on  the  development  of  correlators  based  on  accoustic  wave  inter- 
actions (Menager  and  Desonmiere,  1975;  Reeder  and  Gilden,  1973; 
Jones  et  al,  1972). 

V.  CONCLUSIONS 

It  has  been  seen  in  this  chapter  that  correlation  tech- 
niques are  powerful  and  widely  applicable  methods  for  the  genera 
tion  and  processing  of  chemical  information.  Very  often  correJa 
tion  techniques  provided  unique  measurement  capability  as  well 
as  fresh  insight  into  the  applicability  and  limitations  of  a 
particular  method.  Also  it  was  seen  that  correlation  provides 
a remarkably  unifying  point  of  view  from  which  to  consider  and 
assess  the  wide  range  of  measurement  and  processing  techniques 
available  to  scientists.  Present  and  future  instrumental  and 
conceptual  developments  are  sure  to  extend  even  further  the 
power  and  utility  of  correlation  methods. 
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Block  diagram  of  a simple  correlator. 
Autocorrelation  of  a sine  wave. 

Autocorrelation  function  of  a sine  wave. 
Autocorrelation  of  a square  wave. 

Autocorrelation  of  a rectangular  pulse. 

Cosine  autocorrelation  images. 

Autocorrelation  of  a random  waveform. 
Autocorrelation  function  of  bandlimited  noise  (a) 
and  of  a noisy  sine  wave  (b) . 

Cross-correlation  funcv-.on  of  two  sine  waves. 
Cross-correlation  of  a sine  and  square  wave 
(lock->in  amplifier)  at  x = 0. 

Convolution  and  correlation  of  a step  waveform 
with  an  exponential  instrument  response  function. 
FFT  outputs  resulting  from  Fourier  transformation 
of  a simple  peak  signal.  The  phase  spectrum  (12e) 
is  modulo  2xr. 

Fourier  domain  digital  filters. 

Second  derivative  (a)  and  "deconvolution"  (b) 
Fourier  domain  digital  filters. 

Smoothing  of  a signal  by  direct  cross-correlation 
(a,b,c)  and  by  Fourier  domain  digital  filtering 
(a  ,d  ,e , f ,c)  . 

Removal  and  analysis  of  high  frequency  noise  on 
a signal. 
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Figure  17 

Figure  18 
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Removal  of  fixed  frequency  noise  (a,b,c)  and  mini- 
mization of  quantizing  noise  (d,e,f)  by  Fourier  do- 
main digital  filtering. 

Fourier  domain  smoothing  functions  and  the  resulting 
smoothed  peak.  The  original  peak  is  *»hown  in 
Figure  15a. 

Low  signal-to-noise  ratio  peak  signals  and  the 
smoothed  peaks  as  determined  by  cross-correlation 
with  a noise  free  peak  (matched  filter) . 

Effects  of  conventional  and  modified  Fourier 
transform  smoothing  algorithms  on  an  exponential 
decay  function.  (Hayes  et  al.,  1973). 

First  derivative  of  a spectrum.  The  Fourier  domain 
differentiating  filter  (b)  is  applied  in  a manner 
analogous  to  that  depicted  in  Figure  15. 

Resolution  enhancement  using  a "first  derivative" 
type  Fourier  domain  digital  filter. 

Resolution  enhancement  using  a Fourier  domain 
second  derivative  digital  filter. 

Spectral  response  function  (a)  and  its  Fourier 
transform  (b) . 

A Fourier  domain  deconvolution  digital  filter. 
Deconvolution  of  the  noisy  i.  rentzian  doublet 
shown  in  Figure  23b. 
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Figure  27 

Figure  28 
Figure  29 

Figure  30 

Figure  31 

Figure  32 


Figure  33 

Figure  34 

Figure  35 

Figure  36 


Pattern  detection  by  cross-correlation.  (a)  Signal 
waveform,  (b)  sought-for  pattern,  (c)  cross- 
correlation  function. 

Cobalt nickel  and  iron  spectra. 

Cross-correlation  functions  for  Co  and  Co  (a) , 

Co  and  Ni  (b) , and  Co  and  Fe  (c)  spectra. 

Block  diagram  of  noise  autocorrelation  measurement 
system  for  photocurrents . 

Linearity  of  the  shot  noise  autocorrelation  measure- 
ment system. 

Chart  records  illustrating  the  effect  of  impulse 
noise  on  a lock-in  amplifier  output.  Arrows 
indicate  introduction  of  impulses,  (a)  10  sec 
time  constant,  (b)  1 sec  time  constant. 

Illustration  of  the  effect  of  impulse  noise  on 
the  correlator  output.  Effective  time  constant 
was  13  sec. 

Determination  of  system  impulse  response  and  fre- 
quency characteristics  usinq  random  noise. 

Block  diagram  of  a correlation  measurement  system 
for  the  measurement  of  decayinq  exponentials 
(Miller  et  al . , 1975) . 

Block  diagram  of  a minicomput  r data  acquisition 
system  applicable  to  laboratory  correlation  measure- 


ments . 
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Figure  38 

Figure  39 

Figure  40 
Figure  41 
Figure  42 
Figure  43 

Figure  44 

Figure  45 

Figure  46 
Figure  47 
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Basic  analog  correlators. 

Typical  function  generators  for  (a)  a qate  waveform 
and  (b)  a decaying  exponential. 

(a)  Correlator  for  repetitive  signals. 

(b)  Binary  pattern  correlator  (digital  scanning 
boxcar  integrator) . 

General  purpose  hybrid  correlator. 

Photograph  of  a 512  element  photodiode  array. 
Schematic  of  photodiode  array. 

Block  diagram  of  the  cross-correlation  readout 
system  (a)  and  schematic  waveforms  at  points  X 
and  Y (b) . 

Function  generator  (a)  and  schematic  representation 
of  output  waveforms  from  the  gate  monostables  (b) . 
(resistor  values  are  in  kft) 

Resolution  enhancement  (a)  and  differentiation  (b) 
using  the  cross-correlation  readout  system. 
Schematic  of  a diode  array  serial  analog  memory. 
Tapped  analog  delay  line. 

Schematic  of  CCD  operation. 
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